-- Logs begin at Mon 2022-07-04 09:28:19 UTC, end at Mon 2022-07-04 10:31:32 UTC. -- Jul 04 09:55:11.406545 dv-cinder-848418-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 04 09:55:11.415033 dv-cinder-848418-1-smb devstack@keystone.service[80346]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 09:55:11 2022] *** Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: nodename: dv-cinder-848418-1-smb Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: machine: x86_64 Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: clock source: unix Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: pcre jit disabled Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: detected number of CPU cores: 4 Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: current working directory: / Jul 04 09:55:11.417562 dv-cinder-848418-1-smb devstack@keystone.service[80346]: detected binary path: /usr/bin/uwsgi-core Jul 04 09:55:11.418209 dv-cinder-848418-1-smb devstack@keystone.service[80346]: your processes number limit is 47680 Jul 04 09:55:11.418209 dv-cinder-848418-1-smb devstack@keystone.service[80346]: your memory page size is 4096 bytes Jul 04 09:55:11.418209 dv-cinder-848418-1-smb devstack@keystone.service[80346]: detected max file descriptor number: 2048 Jul 04 09:55:11.418209 dv-cinder-848418-1-smb devstack@keystone.service[80346]: lock engine: pthread robust mutexes Jul 04 09:55:11.418209 dv-cinder-848418-1-smb devstack@keystone.service[80346]: thunder lock: enabled Jul 04 09:55:11.418209 dv-cinder-848418-1-smb devstack@keystone.service[80346]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 04 09:55:11.418209 dv-cinder-848418-1-smb devstack@keystone.service[80346]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 09:55:11.461443 dv-cinder-848418-1-smb devstack@keystone.service[80346]: Python main interpreter initialized at 0x5632a167f9c0 Jul 04 09:55:11.461443 dv-cinder-848418-1-smb devstack@keystone.service[80346]: python threads support enabled Jul 04 09:55:11.461443 dv-cinder-848418-1-smb devstack@keystone.service[80346]: your server socket listen backlog is limited to 100 connections Jul 04 09:55:11.461443 dv-cinder-848418-1-smb devstack@keystone.service[80346]: your mercy for graceful operations on workers is 90 seconds Jul 04 09:55:11.461811 dv-cinder-848418-1-smb devstack@keystone.service[80346]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 09:55:11.461888 dv-cinder-848418-1-smb devstack@keystone.service[80346]: *** Operational MODE: preforking *** Jul 04 09:55:11.462131 dv-cinder-848418-1-smb devstack@keystone.service[80346]: *** uWSGI is running in multiple interpreter mode *** Jul 04 09:55:11.462131 dv-cinder-848418-1-smb devstack@keystone.service[80346]: spawned uWSGI master process (pid: 80346) Jul 04 09:55:11.462334 dv-cinder-848418-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 04 09:55:11.462873 dv-cinder-848418-1-smb devstack@keystone.service[80346]: spawned uWSGI worker 1 (pid: 80353, cores: 1) Jul 04 09:55:11.463207 dv-cinder-848418-1-smb devstack@keystone.service[80346]: spawned uWSGI worker 2 (pid: 80354, cores: 1) Jul 04 09:55:11.467645 dv-cinder-848418-1-smb devstack@keystone.service[80346]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 09:55:16.917493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:55:16.917493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: from cryptography.utils import int_from_bytes Jul 04 09:55:16.918258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:55:16.918258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: from cryptography.utils import int_from_bytes Jul 04 09:55:16.918676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:55:16.918676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: from cryptography.utils import int_from_bytes Jul 04 09:55:16.918785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:55:16.918785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: from cryptography.utils import int_from_bytes Jul 04 09:55:16.967159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:55:16.967359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:55:16.967453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:55:16.967540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] command line args: [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:55:16.967648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:55:16.967825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] command line args: [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:55:16.967916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:55:16.968024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ================================================================================ {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:55:16.968111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:55:16.968264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ================================================================================ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:55:16.968350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] admin_token = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.968518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] config_dir = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.968608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] admin_token = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.968708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.968795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_dir = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.968893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] config_source = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.968978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] debug = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] config_source = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] debug = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969578 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.969919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] list_limit = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] log_config_append = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_config_append = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.970950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] log_dir = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_dir = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] log_file = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.971987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.972969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.973881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.974036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.974120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.974285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.974369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.974562 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.974647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975045 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] publish_errors = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] publish_errors = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.975947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] standard_threads = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] standard_threads = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.976929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_journal = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] use_journal = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] use_json = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_json = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] use_stderr = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.977953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_stderr = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.978070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] use_syslog = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.978196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] use_syslog = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.978196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.978421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:55:16.978536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.978657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.978786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.978903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.979984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.980959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.981957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.982978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.983951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.984925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.985989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.986206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.986326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.986442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.986572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.986689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.986812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.986929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.987935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.988969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.989940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.990892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.991904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.992947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.993603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.993739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.993856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.993965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.994934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995048 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.995993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.996934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.997976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.998930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:16.999998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.000157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.000274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.000399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.000594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.000714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.000831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.000948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.001930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.002875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003000 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.003988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.external = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] auth.external = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.004967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.password = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] auth.token = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] auth.password = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.005959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] auth.token = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006578 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.006942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.007949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] credential.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.008066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.008183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.008313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.008432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.008552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.009309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.009436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.009557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.009684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.009804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.009922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.010890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.011990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.012964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.013925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.014896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.015949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.016913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.017990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.018935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.019906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.020882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.021958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.022913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.023920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.024924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.025990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.026935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.027943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.028921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.029994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.030942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.031910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.032994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.033944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.034975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.035997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.036949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.037905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.038930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] role.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] role.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.039957 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.040955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.041908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.042997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.043975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.044196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.044313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.044438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.044556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.044681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.044799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.044916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045512 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.045990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.046935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.047943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.048904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.049977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.050934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.051925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.connection = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.052899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.053964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.054089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.054209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.054325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.054443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.054559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.054678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.054804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.055173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.055292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.055409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80353) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:55:17.056939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:55:17.056939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:55:17.083280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.083513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.083765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.083883 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.084120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.084355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.092128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.092702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.120695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.120919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.121006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.121154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.263621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.264321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.313291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.313517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.313948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.314190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.381470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.381705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.381918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.382136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.382353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.382563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.382878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.383116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.383339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.383559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.384414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.384949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.409216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.409372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.409454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.409613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.409724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.409802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.409929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.410014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.410146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.410230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.410359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.410441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.410572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.410655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.421759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.421994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.434650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.434882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.435956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80354) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.436038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.436167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.436381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80353) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 09:55:17.453755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.453969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:55:17.454055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.454186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:55:17.454306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.454509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:55:17.454592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.454707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 09:55:17.454789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.454976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.455059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.455237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.455319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.455492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.455601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.455769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.466956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.467197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.467282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.467471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.467554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.467762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.467862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.468043 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.476074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.476292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.479394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.479608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.479746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.479887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.479971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.480164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.480260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.480440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.480563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.480719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.480830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.480977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.481062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.481242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.481323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.481511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.481592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.481777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.481859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.482039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.482120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.482300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.509158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.509551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.510779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.511060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.511168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.511447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.516424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.516665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.516747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.516999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.517081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.517392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.524936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.525217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.525302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.525528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.529743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.530018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.530102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.530297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.530379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.530574 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.530657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.530843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.530925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.531109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.531190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.531375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.531458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.531665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.531751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.531932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.550492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.550732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.550818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.551007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.555782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.555917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.559471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.559673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.559822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.559964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.564948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.565086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.568621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.568775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.572823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.573043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.573201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.573350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.573495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.573640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.573794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.573939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.574080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.574234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.574377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.574518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.593847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.594001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.594132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.594289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.594431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.594564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.594698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.594835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.603031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.603436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.604920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.605189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.605329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.605541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.608478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.608760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.608889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.609043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.609182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.609312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.609448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.609575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.609702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.609903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.623402 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.623702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.623835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.623973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.624120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.624253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.624415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.624542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.624673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.624875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.626167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.626471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.626598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.626820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.644400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.644859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.647699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.648198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.651038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.651546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.652793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.653303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.654429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.654708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.654939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.655082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.655210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.655489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.662298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.662873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.663931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.664541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.667708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.667995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.668338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.668894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.669050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.669193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.669345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.669345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.677768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.678053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.678329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.678487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.678689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.678971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.687121 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80353) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.687400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.687701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.687839 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80354) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 09:55:17.687977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.688110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.688261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.688388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.688529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.688657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.688785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.688914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.689115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.689254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.689384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.689521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.689657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.689834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.689965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.690102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.690231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.690360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.690495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.690633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.690763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80353) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.690890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.691018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.691240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80354) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 09:55:17.732958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632a167f9c0 pid: 80354 (default app) Jul 04 09:55:17.733727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632a167f9c0 pid: 80353 (default app) Jul 04 09:55:17.736462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f09d5-25f1-4dbf-9d2a-b2565220b2ef None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:17.736756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f09d5-25f1-4dbf-9d2a-b2565220b2ef None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:17.737042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f09d5-25f1-4dbf-9d2a-b2565220b2ef None None] PATH_INFO: `/v3` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:17.741288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Mon Jul 4 09:55:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:25.432382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837e0e-70be-45de-a5c3-153b7a566803 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:25.432957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837e0e-70be-45de-a5c3-153b7a566803 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:25.432957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2837e0e-70be-45de-a5c3-153b7a566803 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:25.437275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1/2] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:55:25.442527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:25.442958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:25.443087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:25.513652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: INFO dbcounter [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] Registered counter for database keystone Jul 04 09:55:25.534520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG oslo_db.sqlalchemy.engines [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:55:25.540916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writer thread running {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:55:25.718811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG passlib.handlers.bcrypt [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80354) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 09:55:25.719233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG passlib.handlers.bcrypt [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80354) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 09:55:25.773346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:25.775600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:25.896552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 09:55:26.095566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837e0e-70be-45de-a5c3-153b7a566803 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:26.165244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: INFO dbcounter [None req-f2837e0e-70be-45de-a5c3-153b7a566803 None None] Registered counter for database keystone Jul 04 09:55:26.184645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG oslo_db.sqlalchemy.engines [None req-f2837e0e-70be-45de-a5c3-153b7a566803 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80353) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:55:26.190770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writer thread running {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:55:26.309375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2837e0e-70be-45de-a5c3-153b7a566803 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:26.313561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31ba2-52fe-4886-9ab3-d99801875a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:26.314217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31ba2-52fe-4886-9ab3-d99801875a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:26.314501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31ba2-52fe-4886-9ab3-d99801875a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:26.314776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31ba2-52fe-4886-9ab3-d99801875a76 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:26.323837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a31ba2-52fe-4886-9ab3-d99801875a76 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:26.376033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90a31ba2-52fe-4886-9ab3-d99801875a76 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 09:55:26.376310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a31ba2-52fe-4886-9ab3-d99801875a76 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:26.385996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 2/4] 10.222.0.78 () {58 vars in 1324 bytes} [Mon Jul 4 09:55:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:55:26.392103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:26.406468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4fb67-7b17-47e3-845f-8791efcfeedc None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:26.411057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791ba6-928a-4ee3-8ad4-5ed8088294df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:26.412211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791ba6-928a-4ee3-8ad4-5ed8088294df admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:26.412502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791ba6-928a-4ee3-8ad4-5ed8088294df admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:26.412781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791ba6-928a-4ee3-8ad4-5ed8088294df admin admin] PATH_INFO: `/v3/projects/b97d6692af504c1fa68b44270187348b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:26.417432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791ba6-928a-4ee3-8ad4-5ed8088294df admin admin] RBAC: Authorizing `identity:get_project(project_id=b97d6692af504c1fa68b44270187348b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:26.468528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d1791ba6-928a-4ee3-8ad4-5ed8088294df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 09:55:26.469108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791ba6-928a-4ee3-8ad4-5ed8088294df admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:26.473485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 3/5] 10.222.0.78 () {56 vars in 1207 bytes} [Mon Jul 4 09:55:26 2022] GET /identity/v3/projects/b97d6692af504c1fa68b44270187348b => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:28.502111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fe328-10e7-44d0-9113-f36057d98101 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:28.502632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fe328-10e7-44d0-9113-f36057d98101 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:28.502718 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fe328-10e7-44d0-9113-f36057d98101 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:28.506839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 3/6] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:55:28.512463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27500-7e88-4c86-aee3-e1cc735d01c8 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:28.512903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27500-7e88-4c86-aee3-e1cc735d01c8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:28.513030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27500-7e88-4c86-aee3-e1cc735d01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:28.532152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-76d27500-7e88-4c86-aee3-e1cc735d01c8 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:28.533678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-76d27500-7e88-4c86-aee3-e1cc735d01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:28.542444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 09:55:28.565841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fe328-10e7-44d0-9113-f36057d98101 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:28.578798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fe328-10e7-44d0-9113-f36057d98101 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:28.583033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54294838-6ba3-499e-91ef-f15924737be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:28.583703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294838-6ba3-499e-91ef-f15924737be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:28.583997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294838-6ba3-499e-91ef-f15924737be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:28.584280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294838-6ba3-499e-91ef-f15924737be2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:28.592117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54294838-6ba3-499e-91ef-f15924737be2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:28.593899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54294838-6ba3-499e-91ef-f15924737be2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:28.603313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1324 bytes} [Mon Jul 4 09:55:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 09:55:28.608963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27500-7e88-4c86-aee3-e1cc735d01c8 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:28.618854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27500-7e88-4c86-aee3-e1cc735d01c8 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:28.623294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830c5d-54a0-4426-bd13-8f1fe62d2a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:28.624213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830c5d-54a0-4426-bd13-8f1fe62d2a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:28.624504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830c5d-54a0-4426-bd13-8f1fe62d2a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:28.624787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830c5d-54a0-4426-bd13-8f1fe62d2a6e admin admin] PATH_INFO: `/v3/users/657ce8ca189845ff90a9f70d2e00122f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:28.626201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be830c5d-54a0-4426-bd13-8f1fe62d2a6e admin admin] RBAC: Authorizing `identity:get_user(user_id=657ce8ca189845ff90a9f70d2e00122f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:28.628071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be830c5d-54a0-4426-bd13-8f1fe62d2a6e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:28.629657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 5/9] 10.222.0.78 () {56 vars in 1198 bytes} [Mon Jul 4 09:55:28 2022] GET /identity/v3/users/657ce8ca189845ff90a9f70d2e00122f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:30.736487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790bec6-7639-42ba-9218-7e513574c497 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:30.737020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790bec6-7639-42ba-9218-7e513574c497 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:30.737111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790bec6-7639-42ba-9218-7e513574c497 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:30.737793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5d6d-66db-483b-8d8b-3327ba28555d None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:30.738163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5d6d-66db-483b-8d8b-3327ba28555d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:30.738360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5d6d-66db-483b-8d8b-3327ba28555d None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:30.738499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 5/10] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:30.739760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 6/11] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:55:30.743946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:30.744241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:30.744523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:30.745229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c252b7-443d-4e4d-ba11-6ac3485778de None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:30.745517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c252b7-443d-4e4d-ba11-6ac3485778de None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:30.745798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c252b7-443d-4e4d-ba11-6ac3485778de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:30.762859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-43c252b7-443d-4e4d-ba11-6ac3485778de None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:30.764069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-43c252b7-443d-4e4d-ba11-6ac3485778de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:30.784811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG passlib.handlers.bcrypt [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80353) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 09:55:30.785241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG passlib.handlers.bcrypt [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80353) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 09:55:30.831384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:30.832948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:30.846945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 7/12] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:30.870255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c252b7-443d-4e4d-ba11-6ac3485778de None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:30.893184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:30.934104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:30.957915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:30.975527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c252b7-443d-4e4d-ba11-6ac3485778de None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.009136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.009785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.010068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.010343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.060723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4477d5-6148-4d08-b4c9-9734c6c120c8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.063064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:31.077704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:31.079388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:31.099609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.100605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.100892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.101175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.102590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:31.113252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:31.124634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:31.125616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:31.126453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 7/14] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:55:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:55:31.131664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:31.181138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 8/15] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:55:31.186543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:31.233392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2c7b9-c39d-4677-8afe-fe9c887f7bf5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.267592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.268267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.268552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.268829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.269582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:31.269889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:31.271322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:31.283976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 8/16] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:31.284759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861528-c65c-473a-ba89-15fd45f8f132 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.289917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:31.308042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:31.319678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:31.321306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.322259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.322548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.322824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.332964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:31.334442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:55:31.356334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:31.357271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:31.358112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:55:31.358112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:55:31.358112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:55:31.358112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:31.358112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 9/17] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:55:31.363165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:31.394766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419ca0e-350c-4a01-bb8a-e70d69f91f1f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.429699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.430665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.430947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.431233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] PATH_INFO: `/v3/users/657ce8ca189845ff90a9f70d2e00122f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.432841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] RBAC: Authorizing `identity:get_user(user_id=657ce8ca189845ff90a9f70d2e00122f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:31.434304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:31.436209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 9/18] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:31 2022] GET /identity/v3/users/657ce8ca189845ff90a9f70d2e00122f => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:31.441208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:31.460652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1e85-75fd-4c06-946e-6738a04f3d20 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.499121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.499804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.500089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.500367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.501096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:31.501404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:31.502829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:31.522327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 10/19] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:31.544226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:31.552152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ef30a-ac69-435e-b734-d0896eb5d318 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.590288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd865b59-9131-4843-80ca-697b30180abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.591140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865b59-9131-4843-80ca-697b30180abe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.591422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865b59-9131-4843-80ca-697b30180abe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.591732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd865b59-9131-4843-80ca-697b30180abe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.592990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd865b59-9131-4843-80ca-697b30180abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:31.594470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd865b59-9131-4843-80ca-697b30180abe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:31.596161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 10/20] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:31.602640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:31.638764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:31.708108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4db8-72d5-4e67-b46a-edd000a4754c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:31.743482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b1b5-558a-4e5f-92ed-e8ec1fc8241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:31.744375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b1b5-558a-4e5f-92ed-e8ec1fc8241a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:31.744659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b1b5-558a-4e5f-92ed-e8ec1fc8241a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:31.744938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b1b5-558a-4e5f-92ed-e8ec1fc8241a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:31.745785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b1b5-558a-4e5f-92ed-e8ec1fc8241a None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.domain.id=default, user.id=657ce8ca189845ff90a9f70d2e00122f) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:31.746093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b1b5-558a-4e5f-92ed-e8ec1fc8241a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:31.747548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b1b5-558a-4e5f-92ed-e8ec1fc8241a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:31.755058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 11/21] 10.222.0.78 () {56 vars in 1322 bytes} [Mon Jul 4 09:55:31 2022] GET /identity/v3/role_assignments?user.id=657ce8ca189845ff90a9f70d2e00122f&scope.domain.id=default&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:34.037038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4840c-de9e-4364-a6ba-b9173dbb7711 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.037547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4840c-de9e-4364-a6ba-b9173dbb7711 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.037620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4840c-de9e-4364-a6ba-b9173dbb7711 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.039261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 11/22] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:34.044334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947b77-0e27-46b1-9899-339b0c1f9e78 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.044775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947b77-0e27-46b1-9899-339b0c1f9e78 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.044947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947b77-0e27-46b1-9899-339b0c1f9e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.072580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-87947b77-0e27-46b1-9899-339b0c1f9e78 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:34.073774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-87947b77-0e27-46b1-9899-339b0c1f9e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:34.155966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a837-11e5-4622-9e30-38c490432450 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.156276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a837-11e5-4622-9e30-38c490432450 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.156526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a837-11e5-4622-9e30-38c490432450 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.157895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 12/23] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:55:34.161075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 12/24] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:34.165217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46442-514b-47ce-880b-7ec5a25a7ecb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.165511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46442-514b-47ce-880b-7ec5a25a7ecb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.165757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46442-514b-47ce-880b-7ec5a25a7ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.197365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947b77-0e27-46b1-9899-339b0c1f9e78 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:34.208752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dcd46442-514b-47ce-880b-7ec5a25a7ecb None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:34.210088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dcd46442-514b-47ce-880b-7ec5a25a7ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:34.257248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:34.318229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 13/25] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:34.319338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a2af4-50ae-4725-9a7d-198054b598c4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.319651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a2af4-50ae-4725-9a7d-198054b598c4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.319933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a2af4-50ae-4725-9a7d-198054b598c4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.321785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 14/26] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:34.328946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13e153-df9d-4880-8595-02c4e5065a6e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.329233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13e153-df9d-4880-8595-02c4e5065a6e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.329515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13e153-df9d-4880-8595-02c4e5065a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.363753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-eb13e153-df9d-4880-8595-02c4e5065a6e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:34.364978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eb13e153-df9d-4880-8595-02c4e5065a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:34.388428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947b77-0e27-46b1-9899-339b0c1f9e78 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:34.432721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:34.433648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.434161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.434581 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.436401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:34.439377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:34.522944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:34.524617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13e153-df9d-4880-8595-02c4e5065a6e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:34.567943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:34.639901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13e153-df9d-4880-8595-02c4e5065a6e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:34.676636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 13/28] 10.222.0.78 () {60 vars in 1131 bytes} [Mon Jul 4 09:55:34 2022] POST /identity/v3/roles => generated 219 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:55:34.677767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:34.683291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:34.684164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.684457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.684743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.706350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:34.707879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:55:34.728551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:34.729433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:34.730259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:55:34.730259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:55:34.730259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:55:34.730259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:34.730259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 16/29] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:34.735697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:34.882270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:34.892793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:34.909613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c637af-d7f1-4ee0-9d46-9a4706fb29aa None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:34.931352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9289f-fb87-47b6-861c-f7a87a8b7a91 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:34.949966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fc63d-0452-4391-9031-4980d71bbecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:34.950990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fc63d-0452-4391-9031-4980d71bbecd None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.951552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fc63d-0452-4391-9031-4980d71bbecd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.952207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fc63d-0452-4391-9031-4980d71bbecd None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.953867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fc63d-0452-4391-9031-4980d71bbecd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:34.955931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fc63d-0452-4391-9031-4980d71bbecd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:34.976272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 14/30] 10.222.0.78 () {60 vars in 1131 bytes} [Mon Jul 4 09:55:34 2022] POST /identity/v3/roles => generated 225 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:34.978749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053c29-2f0e-48f0-8fa5-9898e092169b None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.979477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053c29-2f0e-48f0-8fa5-9898e092169b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.980013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81053c29-2f0e-48f0-8fa5-9898e092169b None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.983636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:34.983799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.984039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.985701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:34.985701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:34.985701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:34.986730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:34.988067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 15/31] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:34.995810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b660-9211-40b9-9b35-a86dc5a17d12 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:34.996508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b660-9211-40b9-9b35-a86dc5a17d12 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:34.997775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12b660-9211-40b9-9b35-a86dc5a17d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.025229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-cc12b660-9211-40b9-9b35-a86dc5a17d12 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:35.026783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 17/32] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:35.029898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cc12b660-9211-40b9-9b35-a86dc5a17d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:35.032144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.122219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 16/33] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:35.164660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12b660-9211-40b9-9b35-a86dc5a17d12 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.211676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb1ed6-5187-4ae0-8205-974fe27400d1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:35.253268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360a523-dc05-4746-9da7-3f3da8fa2dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:35.253943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360a523-dc05-4746-9da7-3f3da8fa2dd0 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.254221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360a523-dc05-4746-9da7-3f3da8fa2dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.254494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360a523-dc05-4746-9da7-3f3da8fa2dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.255316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360a523-dc05-4746-9da7-3f3da8fa2dd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:35.256968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360a523-dc05-4746-9da7-3f3da8fa2dd0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:35.261469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:35.288399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:35.317507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12b660-9211-40b9-9b35-a86dc5a17d12 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:35.357668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:35.358810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.359199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.360446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.373687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:35.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:35.384490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:35.385267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:35.385841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 17/34] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:55:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:55:35.392056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.429224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 18/35] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:55:35 2022] POST /identity/v3/projects => generated 301 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:35.434590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92f8a-63c6-49d9-8a8a-52a3aed90e21 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.434938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92f8a-63c6-49d9-8a8a-52a3aed90e21 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.435161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92f8a-63c6-49d9-8a8a-52a3aed90e21 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.438886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:35.442636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42564ac-db62-4a47-b090-1ac4b6c27e39 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.442930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42564ac-db62-4a47-b090-1ac4b6c27e39 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.443215 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42564ac-db62-4a47-b090-1ac4b6c27e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.464288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d42564ac-db62-4a47-b090-1ac4b6c27e39 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:35.465868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d42564ac-db62-4a47-b090-1ac4b6c27e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:35.509615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9781-da45-461a-9e96-338c58907655 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:35.555378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:35.555670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 20/37] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:35.558878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210d220-1d37-46f2-84bd-b0ac8d236e79 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.558878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210d220-1d37-46f2-84bd-b0ac8d236e79 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.558878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210d220-1d37-46f2-84bd-b0ac8d236e79 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.559198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 21/38] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:35.562399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.562860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.563299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.564855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:35.565368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:35.565834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82911356-d44f-461f-9cd2-3e4c92a7d7e0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.566196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82911356-d44f-461f-9cd2-3e4c92a7d7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.566538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82911356-d44f-461f-9cd2-3e4c92a7d7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.567701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:35.584757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-82911356-d44f-461f-9cd2-3e4c92a7d7e0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:35.586079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-82911356-d44f-461f-9cd2-3e4c92a7d7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:35.587906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:35.592585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 18/39] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:35.593656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.670180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 22/40] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:35.672451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82911356-d44f-461f-9cd2-3e4c92a7d7e0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.717874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9ce0-cb5b-404a-a7d2-df8ad3caf324 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:35.721395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:35.754092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:35.754896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.755197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.755490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.756739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:35.758304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:35.760147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 19/41] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:35.760716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.777771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82911356-d44f-461f-9cd2-3e4c92a7d7e0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:35.812948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:35.813827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.814119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.814403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] PATH_INFO: `/v3/users/657ce8ca189845ff90a9f70d2e00122f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.815653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=657ce8ca189845ff90a9f70d2e00122f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:35.817245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:35.818927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 23/42] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:35 2022] GET /identity/v3/users/657ce8ca189845ff90a9f70d2e00122f => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:35.819700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.829119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:35.863373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82d811-bb5c-44d0-b9d3-c7b66b4975cd None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:35.897994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:35.899200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.899487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.899796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.900553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:35.901952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:35.915419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 20/43] 10.222.0.78 () {60 vars in 1131 bytes} [Mon Jul 4 09:55:35 2022] POST /identity/v3/roles => generated 223 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:35.920018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3853ae-120d-4fb2-ab92-277eea8eb3c4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:35.920552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:35.936370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:35.960067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:35.961342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:35.961626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:35.961898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:35.962650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:35.964253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:35.997808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 24/44] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:55:35 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:36.175258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53af440-7cc4-468d-9839-01a0f615055d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:36.202623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:36.211732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b431e8-65cf-42a6-8235-825968c9bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:36.212533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b431e8-65cf-42a6-8235-825968c9bbde None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:36.212816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b431e8-65cf-42a6-8235-825968c9bbde None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:36.213090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b431e8-65cf-42a6-8235-825968c9bbde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:36.214268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b431e8-65cf-42a6-8235-825968c9bbde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:36.215911 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b431e8-65cf-42a6-8235-825968c9bbde None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:36.217542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 21/45] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:36.223631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:36.332176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf913-2c19-43f4-9169-ca4ac09e0119 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:36.369860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88effed2-3a98-4415-aed9-c64f026ffbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:36.370755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88effed2-3a98-4415-aed9-c64f026ffbfa None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:36.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88effed2-3a98-4415-aed9-c64f026ffbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:36.371324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88effed2-3a98-4415-aed9-c64f026ffbfa None admin] PATH_INFO: `/v3/domains/default/users/657ce8ca189845ff90a9f70d2e00122f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:36.374416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88effed2-3a98-4415-aed9-c64f026ffbfa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=657ce8ca189845ff90a9f70d2e00122f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:36.375898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88effed2-3a98-4415-aed9-c64f026ffbfa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:36.391971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 25/46] 10.222.0.78 () {58 vars in 1361 bytes} [Mon Jul 4 09:55:36 2022] PUT /identity/v3/domains/default/users/657ce8ca189845ff90a9f70d2e00122f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:55:38.193577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9ac42-23e7-44a1-bcb8-f52f6acbcee3 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.194102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9ac42-23e7-44a1-bcb8-f52f6acbcee3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.194186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9ac42-23e7-44a1-bcb8-f52f6acbcee3 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.196093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 22/47] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:38.201351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c2ae-ba25-43fe-857b-a5cf17c3ddf6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.201787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c2ae-ba25-43fe-857b-a5cf17c3ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.201915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c2ae-ba25-43fe-857b-a5cf17c3ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.218975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e9d5c2ae-ba25-43fe-857b-a5cf17c3ddf6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:38.220196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e9d5c2ae-ba25-43fe-857b-a5cf17c3ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:38.241020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:38.394524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 26/48] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:38.401184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd66e-6f36-48d6-9b3f-39cd96ba0b23 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.401474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd66e-6f36-48d6-9b3f-39cd96ba0b23 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.401757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd66e-6f36-48d6-9b3f-39cd96ba0b23 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.403304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 23/49] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:38.409964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d2eae-266a-4f7c-b93c-0a2f2a39e01e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.410260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d2eae-266a-4f7c-b93c-0a2f2a39e01e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.410544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d2eae-266a-4f7c-b93c-0a2f2a39e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.418853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd66e-6f36-48d6-9b3f-39cd96ba0b23 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:38.427400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-698d2eae-266a-4f7c-b93c-0a2f2a39e01e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:38.428641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-698d2eae-266a-4f7c-b93c-0a2f2a39e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:38.504543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 27/50] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:38.528606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d2eae-266a-4f7c-b93c-0a2f2a39e01e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:38.530993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd66e-6f36-48d6-9b3f-39cd96ba0b23 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:38.564620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:38.565522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.565810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.566086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.567267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:38.568743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:38.570876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 24/51] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:38.576682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:38.615222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:38.630852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d2eae-266a-4f7c-b93c-0a2f2a39e01e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:38.638079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:38.666483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:38.667292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.667587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.667900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.676248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0477-126c-4212-97bd-69420dc6fe21 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:38.678449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:38.686519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:38.687523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:38.688647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 28/52] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:55:38.693439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:38.713997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:38.714666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.714957 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.715239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.716009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:38.717503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:38.744771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 25/53] 10.222.0.78 () {60 vars in 1140 bytes} [Mon Jul 4 09:55:38 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:55:38.807386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c532e-25dd-4ab0-882d-c04b7496c88a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:38.854270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:38.854965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:38.855249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:38.855528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:38.856323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:38.856634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:38.858049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:38.867281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 29/54] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:38.872982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:38.977892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046445-0c2b-4990-8c67-19dee02ddb14 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:38.994579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:39.013747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:39.014635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:39.014927 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:39.015212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] PATH_INFO: `/v3/users/657ce8ca189845ff90a9f70d2e00122f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:39.016467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] RBAC: Authorizing `identity:get_user(user_id=657ce8ca189845ff90a9f70d2e00122f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:39.017944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:39.019656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 26/55] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:38 2022] GET /identity/v3/users/657ce8ca189845ff90a9f70d2e00122f => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:39.025603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:39.036944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:39.130661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddd500-a54e-493f-b56c-66a4dc75fcab None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:39.172749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64843168-19af-4163-90d9-1d047f037b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:39.173547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843168-19af-4163-90d9-1d047f037b87 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:39.173830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843168-19af-4163-90d9-1d047f037b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:39.174102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843168-19af-4163-90d9-1d047f037b87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:39.175277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64843168-19af-4163-90d9-1d047f037b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:39.176763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64843168-19af-4163-90d9-1d047f037b87 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:39.178388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 30/56] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:39.184876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:39.282501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575ca3a-3481-45fd-8853-2ad25fd57261 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:39.315663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b3a8c-c241-4cd7-836f-c6f5ebb8d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:39.316330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b3a8c-c241-4cd7-836f-c6f5ebb8d703 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:39.316621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b3a8c-c241-4cd7-836f-c6f5ebb8d703 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:39.316905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b3a8c-c241-4cd7-836f-c6f5ebb8d703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:39.317751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b3a8c-c241-4cd7-836f-c6f5ebb8d703 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.domain.id=default, user.id=657ce8ca189845ff90a9f70d2e00122f) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:39.318072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b3a8c-c241-4cd7-836f-c6f5ebb8d703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:39.319539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b3a8c-c241-4cd7-836f-c6f5ebb8d703 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:39.326292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 27/57] 10.222.0.78 () {56 vars in 1322 bytes} [Mon Jul 4 09:55:39 2022] GET /identity/v3/role_assignments?user.id=657ce8ca189845ff90a9f70d2e00122f&scope.domain.id=default&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:40.787136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb26d-979e-4d43-98a1-eb436f17b91f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:40.787670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb26d-979e-4d43-98a1-eb436f17b91f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:40.787755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb26d-979e-4d43-98a1-eb436f17b91f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:40.789627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 31/58] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:40.794931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819578b-05bb-449b-8e35-32bcc7a4e641 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:40.795321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819578b-05bb-449b-8e35-32bcc7a4e641 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:40.795501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819578b-05bb-449b-8e35-32bcc7a4e641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:40.813589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7819578b-05bb-449b-8e35-32bcc7a4e641 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:40.814777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7819578b-05bb-449b-8e35-32bcc7a4e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:40.859943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:40.882821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 28/59] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:40.906458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeb26d-979e-4d43-98a1-eb436f17b91f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:40.985921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:41.009877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeb26d-979e-4d43-98a1-eb436f17b91f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:41.044159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8065532-54ff-47a0-b50c-71332a694698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:41.044954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8065532-54ff-47a0-b50c-71332a694698 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:41.045245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8065532-54ff-47a0-b50c-71332a694698 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:41.045529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8065532-54ff-47a0-b50c-71332a694698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:41.046711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8065532-54ff-47a0-b50c-71332a694698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:41.048198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8065532-54ff-47a0-b50c-71332a694698 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:41.049819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 32/60] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:41.055427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819578b-05bb-449b-8e35-32bcc7a4e641 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:41.151213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819578b-05bb-449b-8e35-32bcc7a4e641 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:41.184109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423cf9f-1da9-4386-939f-b32c6c9e2ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:41.184775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423cf9f-1da9-4386-939f-b32c6c9e2ddb None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:41.185067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423cf9f-1da9-4386-939f-b32c6c9e2ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:41.185348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423cf9f-1da9-4386-939f-b32c6c9e2ddb None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:41.186061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423cf9f-1da9-4386-939f-b32c6c9e2ddb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:41.187500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423cf9f-1da9-4386-939f-b32c6c9e2ddb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:41.212639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 29/61] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:55:41 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:44.294742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9be6a-7bd5-4997-8d10-5b7605fd2c5a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.295800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9be6a-7bd5-4997-8d10-5b7605fd2c5a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.296319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9be6a-7bd5-4997-8d10-5b7605fd2c5a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.298179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 33/62] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:44.303235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba4e-8596-4d0d-bebe-e5bf2ded0c2a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.304399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba4e-8596-4d0d-bebe-e5bf2ded0c2a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.304880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeba4e-8596-4d0d-bebe-e5bf2ded0c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.325854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-8edeba4e-8596-4d0d-bebe-e5bf2ded0c2a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:44.327368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8edeba4e-8596-4d0d-bebe-e5bf2ded0c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:44.359608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:44.414535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 30/63] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:44.453105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9be6a-7bd5-4997-8d10-5b7605fd2c5a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:44.598377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9be6a-7bd5-4997-8d10-5b7605fd2c5a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:44.631611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9e9e-2deb-4652-aa0f-1969ca66be4c None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.631924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9e9e-2deb-4652-aa0f-1969ca66be4c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.632737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9e9e-2deb-4652-aa0f-1969ca66be4c None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.634148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 31/64] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:44.640543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d6e5f-f198-46a0-bc99-98ae7519f5c6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.640840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d6e5f-f198-46a0-bc99-98ae7519f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.641123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d6e5f-f198-46a0-bc99-98ae7519f5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.660630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f04d6e5f-f198-46a0-bc99-98ae7519f5c6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:44.661831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f04d6e5f-f198-46a0-bc99-98ae7519f5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:44.664333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:44.665255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.665646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.665931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.691314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:44.699700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:44.700595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:44.701359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 34/65] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:44.709097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:44.715908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:44.767172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 32/66] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:55:44.769007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ff142-f6b4-4f56-ad1b-24a89bdc701f None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.770076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ff142-f6b4-4f56-ad1b-24a89bdc701f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.770561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ff142-f6b4-4f56-ad1b-24a89bdc701f None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.772569 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 33/67] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:44.784983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb718a-4190-4dac-aee3-0fee612cfa67 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.785399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb718a-4190-4dac-aee3-0fee612cfa67 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.785789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb718a-4190-4dac-aee3-0fee612cfa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.806892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7ccb718a-4190-4dac-aee3-0fee612cfa67 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:44.808703 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7ccb718a-4190-4dac-aee3-0fee612cfa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:44.848308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c1806-95c3-4bd5-ab15-af7fe9653027 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:44.887611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c8a7-30ed-446d-8f3d-d763873ca0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:44.887611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c8a7-30ed-446d-8f3d-d763873ca0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.887611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c8a7-30ed-446d-8f3d-d763873ca0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.887611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c8a7-30ed-446d-8f3d-d763873ca0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.888047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c8a7-30ed-446d-8f3d-d763873ca0a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:44.888047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c8a7-30ed-446d-8f3d-d763873ca0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:44.888329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 34/68] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:44.889184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c8a7-30ed-446d-8f3d-d763873ca0a8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:44.892394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb718a-4190-4dac-aee3-0fee612cfa67 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:44.898892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 35/69] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:44.904391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfe148-58c9-4e8d-afbb-dff0e894e26d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:44.904697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfe148-58c9-4e8d-afbb-dff0e894e26d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:44.904989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfe148-58c9-4e8d-afbb-dff0e894e26d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:44.906370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 36/70] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:44.907110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfe148-58c9-4e8d-afbb-dff0e894e26d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:44.922405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:44.978751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.000624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb718a-4190-4dac-aee3-0fee612cfa67 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.017460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfe148-58c9-4e8d-afbb-dff0e894e26d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.035117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cab97a-1249-4c85-8228-bc00480afba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.035953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab97a-1249-4c85-8228-bc00480afba8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.036244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab97a-1249-4c85-8228-bc00480afba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.036521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab97a-1249-4c85-8228-bc00480afba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.046951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cab97a-1249-4c85-8228-bc00480afba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:45.050675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.051548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.051857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.052133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-47cab97a-1249-4c85-8228-bc00480afba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:45.055193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:45.056164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:45.056924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:45.058747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879f80d-6295-467b-a628-dba6c9b13b2a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.059045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879f80d-6295-467b-a628-dba6c9b13b2a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.059336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879f80d-6295-467b-a628-dba6c9b13b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.067885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.069348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.071623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 37/72] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:44 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:45.072456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.077291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f879f80d-6295-467b-a628-dba6c9b13b2a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:45.078501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f879f80d-6295-467b-a628-dba6c9b13b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:45.145458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 36/73] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:45.146710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133104a-de31-4478-a9dc-768d6225dbf4 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.147010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133104a-de31-4478-a9dc-768d6225dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.147293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133104a-de31-4478-a9dc-768d6225dbf4 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.148621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 37/74] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:45.152681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133104a-de31-4478-a9dc-768d6225dbf4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.168487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.190290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6008b3-5208-4c17-bcb4-29ea6778b6d5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.214135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.224984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.226383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.226670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.226947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.237021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:45.245605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:45.246467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 38/75] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:45.252481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.255886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133104a-de31-4478-a9dc-768d6225dbf4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.289695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032c2f3-8215-4d77-a249-de1762afe958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.290369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032c2f3-8215-4d77-a249-de1762afe958 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.290657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032c2f3-8215-4d77-a249-de1762afe958 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.290939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032c2f3-8215-4d77-a249-de1762afe958 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.291739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032c2f3-8215-4d77-a249-de1762afe958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:45.292054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032c2f3-8215-4d77-a249-de1762afe958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.293472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032c2f3-8215-4d77-a249-de1762afe958 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.301544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 38/76] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:45.302744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f9f7d-23d5-4cfe-aac8-b6a692867174 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.303041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f9f7d-23d5-4cfe-aac8-b6a692867174 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.303326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f9f7d-23d5-4cfe-aac8-b6a692867174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.319838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-421f9f7d-23d5-4cfe-aac8-b6a692867174 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:45.321035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-421f9f7d-23d5-4cfe-aac8-b6a692867174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:45.352242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188641f-b26e-4215-a18a-a9532838ac29 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.386513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.387161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.387257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 39/77] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:45.387454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.387739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.392433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f9f7d-23d5-4cfe-aac8-b6a692867174 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.400901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.443106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.459914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.462209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.493808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f9f7d-23d5-4cfe-aac8-b6a692867174 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.528645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.529462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.529753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.530033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.540688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:45.548776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:45.549648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:45.550418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 40/78] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:45.551068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.564465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 39/79] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:45.565312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.620647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.654962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.657897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef49d1a-86da-49eb-a7c0-af2940e36658 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.672450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274638d-1aa1-42fb-9c2d-b551fc918c37 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.692039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.692707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.692988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.693264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.694013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:45.694315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.695783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.703713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 41/80] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:45.704525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.709770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.711194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.711478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.711795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] PATH_INFO: `/v3/users/657ce8ca189845ff90a9f70d2e00122f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.713003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] RBAC: Authorizing `identity:get_user(user_id=657ce8ca189845ff90a9f70d2e00122f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.714461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.716129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 40/81] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/users/657ce8ca189845ff90a9f70d2e00122f => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:45.716889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.810056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0520f-8208-4946-af7b-964815db80d4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.816509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c651ff2-f6fd-4a42-980c-15734f515637 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.836056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.844884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.845694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.845988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.846271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.847463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.848968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.851330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 42/82] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:45.852074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.852340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.853111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.853404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.853685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.854452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:45.854765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.856280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.864583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 41/83] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:45.865375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:45.881353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:45.955506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade103a-249c-4f26-80be-d55695cb37f8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.967762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614004-b423-4d52-bf3e-914e7b6e58b5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:45.988249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:45.989120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:45.989416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:45.989705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:45.990914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:45.993025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:45.994749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 43/84] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:45.995522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.004698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.005627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.005916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.006194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.007470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.008949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:46.010637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 42/85] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:46.011380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.061036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.093640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.099757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210be50-f85a-426a-8677-c3a4c4046bc1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.112586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce2d9-415c-4c81-99c9-48e3570ab0df None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.133594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.134245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.134535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.134814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.146455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.147130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.147420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.147759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.148490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.149938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:46.175333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 43/86] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:55:46 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:46.176183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.218615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.220491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:46.292421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cd4ec-3f58-44e6-8713-7eec41429f0d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.295932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.340818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 44/87] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:46.342387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.347824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.349315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.349603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.349883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.352804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.354304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:46.356049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 44/88] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:46 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:46.356830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.366245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.477392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c881c-c9aa-4b73-9202-cf1e63154fe0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.489623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfab2-100b-4271-b898-2757c8570fb1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.526606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.528001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.528707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.529162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.530370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=bc2accf2ac544cc5afff8334e1ed9311) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:46.531134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.533146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:46.535534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.536350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.536729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.537081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.540861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 45/89] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:46 2022] GET /identity/v3/role_assignments?user.id=bc2accf2ac544cc5afff8334e1ed9311&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:46.542817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.594013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.623248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.625167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:46.637100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.699175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aca49-a337-408e-ad65-28aa6353ccfb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.737864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.738768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.739061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.739456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.742213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.743500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:46.745690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 46/90] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:46 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:46.746365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.776513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 45/91] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:46.778333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:46.880920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.901821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf974-7440-479a-9c0e-861229fc6e84 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.917241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42bab5-1870-4cc2-ad94-78c1c7c025ec None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:46.927973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:46.973475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.974149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.974439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.974723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.989049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:46.989647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:46.990017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:46.990298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:46.991205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=657ce8ca189845ff90a9f70d2e00122f) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:46.992129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:46.993608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:47.009244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 46/92] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:46 2022] GET /identity/v3/role_assignments?user.id=657ce8ca189845ff90a9f70d2e00122f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:47.010103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:47.097926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:47.099941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:47.128856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555b5a-3b4e-4b3f-8d20-406ba492650e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:47.166764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:47.167533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:47.167881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:47.168281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] PATH_INFO: `/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:47.169581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] RBAC: Authorizing `identity:get_project(project_id=38fec128f6cf47e3b0f9ac41f9ad5f11)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:47.171042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:47.175605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 47/93] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:47 2022] GET /identity/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:47.178824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:47.222581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:47.235950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:47.243886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 47/94] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:47.247037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:47.365149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6cb1-8db0-4dc1-a64d-226d8bb2cc49 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:47.402211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0b45d-b074-4334-beb2-c8e2b31f99c4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:47.404565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:47.405684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:47.406184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:47.406655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:47.408097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:47.410595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:47.412859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 48/95] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:47 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:47.419875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:47.487609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362edd-5b59-47c8-975c-a47c756720e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:47.488300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362edd-5b59-47c8-975c-a47c756720e4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:47.488590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362edd-5b59-47c8-975c-a47c756720e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:47.488871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362edd-5b59-47c8-975c-a47c756720e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:47.489717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362edd-5b59-47c8-975c-a47c756720e4 None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=38fec128f6cf47e3b0f9ac41f9ad5f11, user.id=bc2accf2ac544cc5afff8334e1ed9311) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:47.490033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362edd-5b59-47c8-975c-a47c756720e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:47.492089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362edd-5b59-47c8-975c-a47c756720e4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:47.510929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 48/96] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:47 2022] GET /identity/v3/role_assignments?user.id=bc2accf2ac544cc5afff8334e1ed9311&scope.project.id=38fec128f6cf47e3b0f9ac41f9ad5f11&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:47.528008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:47.582063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9484-cb46-481f-acff-fbab7e13632a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:47.644585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735fd78-af34-4b2b-bfe0-dda6716adcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:47.645678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735fd78-af34-4b2b-bfe0-dda6716adcff None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:47.646164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735fd78-af34-4b2b-bfe0-dda6716adcff None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:47.646648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735fd78-af34-4b2b-bfe0-dda6716adcff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:47.649467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735fd78-af34-4b2b-bfe0-dda6716adcff None admin] RBAC: Adding query filter params (role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=bc2accf2ac544cc5afff8334e1ed9311) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:47.650046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735fd78-af34-4b2b-bfe0-dda6716adcff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:47.652937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735fd78-af34-4b2b-bfe0-dda6716adcff None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:47.671405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 49/97] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:47 2022] GET /identity/v3/role_assignments?user.id=bc2accf2ac544cc5afff8334e1ed9311&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:49.185973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb964d42-1324-45e6-84d8-5b6af93c58f9 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.186986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb964d42-1324-45e6-84d8-5b6af93c58f9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.187475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb964d42-1324-45e6-84d8-5b6af93c58f9 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.189111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 49/98] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:49.194695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be6005-6320-46b3-8703-18bb52a494ff None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.195526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be6005-6320-46b3-8703-18bb52a494ff None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.196038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be6005-6320-46b3-8703-18bb52a494ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.215882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-24be6005-6320-46b3-8703-18bb52a494ff None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:49.217362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-24be6005-6320-46b3-8703-18bb52a494ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:49.301287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 50/99] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:49.341962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb964d42-1324-45e6-84d8-5b6af93c58f9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:49.465764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb964d42-1324-45e6-84d8-5b6af93c58f9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:49.467716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:49.526475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18cccf-e368-418e-aa78-0a9b34cd21c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:49.527298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18cccf-e368-418e-aa78-0a9b34cd21c1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.527879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18cccf-e368-418e-aa78-0a9b34cd21c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.528166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18cccf-e368-418e-aa78-0a9b34cd21c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.544489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18cccf-e368-418e-aa78-0a9b34cd21c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4f18cccf-e368-418e-aa78-0a9b34cd21c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:49.552299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:49.553161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:49.554742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 50/100] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:49.567242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be6005-6320-46b3-8703-18bb52a494ff None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:49.612904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231dfe6-85cd-46f2-944e-28068cd5140f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.613218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231dfe6-85cd-46f2-944e-28068cd5140f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.613480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231dfe6-85cd-46f2-944e-28068cd5140f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.615001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 51/101] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:49.635663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc18e7-d4ad-4f8e-970a-af3de4580d40 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.635663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc18e7-d4ad-4f8e-970a-af3de4580d40 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.635663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc18e7-d4ad-4f8e-970a-af3de4580d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.659004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:49.668239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-45dc18e7-d4ad-4f8e-970a-af3de4580d40 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:49.669486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-45dc18e7-d4ad-4f8e-970a-af3de4580d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:49.723313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be6005-6320-46b3-8703-18bb52a494ff None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:49.795194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:49.796292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.796832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.797300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.798251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:49.799688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:49.802384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:49.827968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 52/102] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 04 09:55:49.829663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3abc-aa1c-4cf3-ae7a-a06d54f7635f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.830134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 51/103] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:49.831162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:49.832046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3abc-aa1c-4cf3-ae7a-a06d54f7635f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.832649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3abc-aa1c-4cf3-ae7a-a06d54f7635f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.837098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 53/104] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:49.873125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af547-0b10-44af-a9cc-bcae82706b55 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:49.873723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af547-0b10-44af-a9cc-bcae82706b55 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:49.874213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af547-0b10-44af-a9cc-bcae82706b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:49.907971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-219af547-0b10-44af-a9cc-bcae82706b55 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:49.910276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-219af547-0b10-44af-a9cc-bcae82706b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:50.041472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 54/105] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 04 09:55:50.042188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219af547-0b10-44af-a9cc-bcae82706b55 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:50.062440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2440-1052-40a8-a742-033ea351cb21 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.077241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:50.123115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:50.170504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219af547-0b10-44af-a9cc-bcae82706b55 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.177245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:50.178161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.178448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.179666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.181138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:50.182762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:50.192715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 52/106] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:49 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:50.193362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:50.220545 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:50.223028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.223807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.225605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.230385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:50.234687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:50.238276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 55/107] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:50.244791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:50.334639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30e67-6191-4a25-bda8-8779b3e9ae4d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.374617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:50.375869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.376360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.376839 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.388736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:50.397014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:50.398029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:55:50.399013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:50.401916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 53/108] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:50.402934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:50.447955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:50.457627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6cca4-e5bf-4d88-a8b4-a9616adb1970 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.461166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:50.498003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:50.498986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.499281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.499561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.500911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:50.502520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:50.504468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 56/109] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:50 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:50.505322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:50.519263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69bb0f-906f-4648-a0f0-1e6f550c1711 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.556290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ecf1a-2096-43b5-9217-c0c2a65114a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:50.557351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ecf1a-2096-43b5-9217-c0c2a65114a2 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.557842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ecf1a-2096-43b5-9217-c0c2a65114a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.558320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ecf1a-2096-43b5-9217-c0c2a65114a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.559246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ecf1a-2096-43b5-9217-c0c2a65114a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:50.560958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ecf1a-2096-43b5-9217-c0c2a65114a2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:50.594751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 54/110] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:55:50 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:50.596700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd13f2c-5a3e-4872-ad80-c4e7ad6c0552 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.597820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd13f2c-5a3e-4872-ad80-c4e7ad6c0552 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.599316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd13f2c-5a3e-4872-ad80-c4e7ad6c0552 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.601791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 55/111] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:50.602834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd13f2c-5a3e-4872-ad80-c4e7ad6c0552 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:50.649903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322244c-598e-4ce1-b36d-dfc7a720e2b0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.708005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfc1ad-7d7c-4e39-832e-44832dd038e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:50.709073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfc1ad-7d7c-4e39-832e-44832dd038e1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.709664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfc1ad-7d7c-4e39-832e-44832dd038e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.711440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfc1ad-7d7c-4e39-832e-44832dd038e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.712497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfc1ad-7d7c-4e39-832e-44832dd038e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:50.713041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfc1ad-7d7c-4e39-832e-44832dd038e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:50.715776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfc1ad-7d7c-4e39-832e-44832dd038e1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:50.728875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 57/112] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:50.731525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6926f0-e0b1-42a0-b094-e9c7931af1d9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.732064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6926f0-e0b1-42a0-b094-e9c7931af1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.732778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6926f0-e0b1-42a0-b094-e9c7931af1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.737688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:50.743368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd13f2c-5a3e-4872-ad80-c4e7ad6c0552 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.759003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-de6926f0-e0b1-42a0-b094-e9c7931af1d9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:50.760420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-de6926f0-e0b1-42a0-b094-e9c7931af1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:50.779035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:50.799456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441bdf-a41b-41af-8bbd-ca74f9faed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:50.800444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441bdf-a41b-41af-8bbd-ca74f9faed67 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.800688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441bdf-a41b-41af-8bbd-ca74f9faed67 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.800965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441bdf-a41b-41af-8bbd-ca74f9faed67 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75/users/bc2accf2ac544cc5afff8334e1ed9311/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.803028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441bdf-a41b-41af-8bbd-ca74f9faed67 None admin] RBAC: Authorizing `identity:create_grant(project_id=175a398948844db0b21c22ce03469d75, user_id=bc2accf2ac544cc5afff8334e1ed9311, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:50.805416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441bdf-a41b-41af-8bbd-ca74f9faed67 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:50.821353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 56/113] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:55:50 2022] PUT /identity/v3/projects/175a398948844db0b21c22ce03469d75/users/bc2accf2ac544cc5afff8334e1ed9311/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:55:50.822488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4865c7-2229-41ef-b6d0-2a3a6228b0cf None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.822785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4865c7-2229-41ef-b6d0-2a3a6228b0cf None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.823071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4865c7-2229-41ef-b6d0-2a3a6228b0cf None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.825209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 57/114] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:50.825938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4865c7-2229-41ef-b6d0-2a3a6228b0cf None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:50.849639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 58/115] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:50.851967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefc68c-43a9-42a6-907b-f2c4854db9d2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.852296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefc68c-43a9-42a6-907b-f2c4854db9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.852654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefc68c-43a9-42a6-907b-f2c4854db9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.873809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6fefc68c-43a9-42a6-907b-f2c4854db9d2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:50.875159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6fefc68c-43a9-42a6-907b-f2c4854db9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:50.960356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4865c7-2229-41ef-b6d0-2a3a6228b0cf None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:50.983898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 59/116] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:50.985494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5acf-d6c9-4111-b29f-98867990e6f2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:50.985795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5acf-d6c9-4111-b29f-98867990e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:50.986082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5acf-d6c9-4111-b29f-98867990e6f2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:50.987438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 60/117] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:50.988203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5acf-d6c9-4111-b29f-98867990e6f2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.017363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb908aa0-0b67-4a8d-a9bc-97b47dacc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.018617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908aa0-0b67-4a8d-a9bc-97b47dacc091 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.019193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908aa0-0b67-4a8d-a9bc-97b47dacc091 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.019713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908aa0-0b67-4a8d-a9bc-97b47dacc091 None admin] PATH_INFO: `/v3/users/7e244ddf75fe49ffb887b37e16dac59f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.039194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb908aa0-0b67-4a8d-a9bc-97b47dacc091 None admin] RBAC: Authorizing `identity:get_user(user_id=7e244ddf75fe49ffb887b37e16dac59f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:51.040754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb908aa0-0b67-4a8d-a9bc-97b47dacc091 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:51.047350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 58/118] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:50 2022] GET /identity/v3/users/7e244ddf75fe49ffb887b37e16dac59f => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:51.048666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876a28-7211-4e82-b160-44c4b6319937 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.048963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876a28-7211-4e82-b160-44c4b6319937 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.049248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876a28-7211-4e82-b160-44c4b6319937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.067133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-10876a28-7211-4e82-b160-44c4b6319937 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:51.068445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-10876a28-7211-4e82-b160-44c4b6319937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:51.083761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.116081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.144393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5acf-d6c9-4111-b29f-98867990e6f2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.146052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 59/119] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:51.147068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10876a28-7211-4e82-b160-44c4b6319937 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.189617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.191358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.191827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.192256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.208122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:51.226385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:51.227827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:51.228618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 61/120] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:55:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:51.229290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.279765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10876a28-7211-4e82-b160-44c4b6319937 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.315932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.316758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.317047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.317328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.328981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:51.337789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:51.339141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:51.340316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 60/121] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:51.344315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.352724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63e53-ab3d-4a61-807e-4b279f530616 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.358382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.393607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.394766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.395280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.395826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.444057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.454601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363757e6-e11e-455d-b711-2a3aad7d9c45 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.473823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:51.475689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:51.491685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.492502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.492788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.493076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.503929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:51.512412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:51.513316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:51.514118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 61/122] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:51.514758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.594535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.602251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 62/123] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:51.603444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.636995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28278f7-edd1-42cf-8bdb-97485dfd08ae None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.651166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.677018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.678039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.678497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.679268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.680287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:51.680800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:51.682511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:51.695779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 62/124] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:51.696959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.715734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26694ccb-e3c5-4e35-a396-174a7bc4d54d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.753759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.754445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.754736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.755018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.755930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:51.756246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:51.757675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:51.771193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 63/125] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:51.771193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.811821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efaa3-63df-4317-98a9-51c8d13a06aa None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.843547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.851924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.852922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.853409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.853885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.854970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:51.855547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:51.857287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:51.867557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 63/126] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:51.868751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:51.887494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddeeb1-ce41-45e1-a5ac-5ae59db1db49 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:51.889302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:51.927807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:51.929564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:51.929747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:51.930000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:51.931679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:51.933144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:51.940150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 64/127] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:51.940150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.004185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f0462-4863-4fa0-9515-e04b2d673468 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.048522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.049737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.050202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.050653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] PATH_INFO: `/v3/users/657ce8ca189845ff90a9f70d2e00122f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.052136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] RBAC: Authorizing `identity:get_user(user_id=657ce8ca189845ff90a9f70d2e00122f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.053703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055167-2ebf-4ef8-b085-61cca67516dd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.054603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.061109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 64/128] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/users/657ce8ca189845ff90a9f70d2e00122f => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:52.062213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.093922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.095011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.095414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.095815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.097278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.098922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.101107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 65/129] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:51 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:52.105535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.129534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:52.148309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:52.173789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843242d-ee96-441d-a62e-26a6674f11a8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.209252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.210943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.211406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.211886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.213279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.215002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.216896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 65/130] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:52 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:52.217898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.225945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee850-56e9-4477-9625-af563a2d4c08 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.275909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.277303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.277731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.278026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.279211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] RBAC: Adding query filter params (role.id=e7fde74e8a8d4b729df16195b4c76439, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=7e244ddf75fe49ffb887b37e16dac59f) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:52.279536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.281459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.293037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 66/131] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:52 2022] GET /identity/v3/role_assignments?user.id=7e244ddf75fe49ffb887b37e16dac59f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=e7fde74e8a8d4b729df16195b4c76439 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:52.295364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.339237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba212-0431-415a-8142-0b2d49da06a4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.398479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:52.433165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.434070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.434360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.434643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.435067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4922e-0835-4ec1-9e69-a33c7153c3fe None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.436983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:52.440497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.444394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.444394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 66/132] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:52 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:52.444729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.509095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.509907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.510189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.510466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.511717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.513161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.515178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 67/133] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:52 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:52.516063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.620517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51b76-6134-42af-ba0f-df23a646fdb6 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.641514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840ad3-d3ba-4c24-9a83-9e42a05fc9a4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.683442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.684654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.684944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.685229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75/users/657ce8ca189845ff90a9f70d2e00122f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.687982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] RBAC: Authorizing `identity:create_grant(project_id=175a398948844db0b21c22ce03469d75, user_id=657ce8ca189845ff90a9f70d2e00122f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.689697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.708153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.710825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.711123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.711411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] PATH_INFO: `/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.713299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 68/134] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:55:52 2022] PUT /identity/v3/projects/175a398948844db0b21c22ce03469d75/users/657ce8ca189845ff90a9f70d2e00122f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:55:52.714303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=38fec128f6cf47e3b0f9ac41f9ad5f11)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.715909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.718844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.722399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 67/135] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:52 2022] GET /identity/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:52.737257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:52.792348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:52.876007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:52.922292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c1ab6-d77c-4faf-a3b8-ec198310ef20 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.933341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0a196-1c33-4e1d-ac81-bd70ebd93bd9 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:52.981159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e09c9d-bf5f-4c8a-80f6-9b4ebf837cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.982102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09c9d-bf5f-4c8a-80f6-9b4ebf837cfa None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.982395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09c9d-bf5f-4c8a-80f6-9b4ebf837cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.982681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09c9d-bf5f-4c8a-80f6-9b4ebf837cfa None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75/users/bc2accf2ac544cc5afff8334e1ed9311/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.983969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352953f-fcf3-423c-9e66-dabe4d84579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:52.984890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352953f-fcf3-423c-9e66-dabe4d84579a None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:52.985176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352953f-fcf3-423c-9e66-dabe4d84579a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:52.985458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352953f-fcf3-423c-9e66-dabe4d84579a None admin] PATH_INFO: `/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11/users/bc2accf2ac544cc5afff8334e1ed9311/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:52.988546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352953f-fcf3-423c-9e66-dabe4d84579a None admin] RBAC: Authorizing `identity:create_grant(project_id=38fec128f6cf47e3b0f9ac41f9ad5f11, user_id=bc2accf2ac544cc5afff8334e1ed9311, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.990053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352953f-fcf3-423c-9e66-dabe4d84579a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:52.993733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e09c9d-bf5f-4c8a-80f6-9b4ebf837cfa None admin] RBAC: Authorizing `identity:create_grant(project_id=175a398948844db0b21c22ce03469d75, user_id=bc2accf2ac544cc5afff8334e1ed9311, role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:52.995377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e09c9d-bf5f-4c8a-80f6-9b4ebf837cfa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:53.024798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 69/136] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:55:52 2022] PUT /identity/v3/projects/175a398948844db0b21c22ce03469d75/users/bc2accf2ac544cc5afff8334e1ed9311/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:55:53.026143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88229a68-8df5-41c2-bf86-c1af9a907026 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.026439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88229a68-8df5-41c2-bf86-c1af9a907026 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.026728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88229a68-8df5-41c2-bf86-c1af9a907026 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.028366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 70/137] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:53.031714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 68/138] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:55:52 2022] PUT /identity/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11/users/bc2accf2ac544cc5afff8334e1ed9311/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:55:53.033992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3f81-dc81-4f6a-ab59-9f42908a4839 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.034293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3f81-dc81-4f6a-ab59-9f42908a4839 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.034587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3f81-dc81-4f6a-ab59-9f42908a4839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.060301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-310c3f81-dc81-4f6a-ab59-9f42908a4839 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:53.061474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-310c3f81-dc81-4f6a-ab59-9f42908a4839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:53.134285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302170-ac6f-41e5-9a5b-68675dd069c8 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.134625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302170-ac6f-41e5-9a5b-68675dd069c8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.134863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302170-ac6f-41e5-9a5b-68675dd069c8 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.136592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 69/139] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:53.152811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09478b6-95ca-47f8-a3f9-87aec468a743 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.153136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09478b6-95ca-47f8-a3f9-87aec468a743 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.153396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09478b6-95ca-47f8-a3f9-87aec468a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.159704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 71/140] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:53.184915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b09478b6-95ca-47f8-a3f9-87aec468a743 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:53.186372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b09478b6-95ca-47f8-a3f9-87aec468a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:53.196114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3f81-dc81-4f6a-ab59-9f42908a4839 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:53.227835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:53.286141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 70/141] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:53.311964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09478b6-95ca-47f8-a3f9-87aec468a743 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:53.334034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3f81-dc81-4f6a-ab59-9f42908a4839 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:53.378716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:53.379618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.379933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.380218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.381460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:53.384091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:53.386571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 72/142] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:55:53.393259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:53.416485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:53.493908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09478b6-95ca-47f8-a3f9-87aec468a743 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:53.531418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:53.532270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.532940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.533232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.546261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:53.558756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:53.560860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:53.562113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 71/143] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:55:53.568770 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:53.616491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:53.637754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742a7ef-08c8-46d2-82dd-a77d5141d960 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:53.706196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:53.706886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.707173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.707452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.708214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:53.709711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:53.749393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 73/144] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:55:53 2022] POST /identity/v3/users => generated 283 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:53.761888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadc93e-8e1b-463f-98c2-2fb1314223c2 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:53.783966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:53.813198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:53.813799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:53.814086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:53.814356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:53.815129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:53.815493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:53.816986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:53.832247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 72/145] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:53.837806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:54.005428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19044-063e-48cf-8030-93d2460d0edb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:54.055311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:54.056245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:54.056531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:54.056810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:54.058050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:54.059513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:54.061690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 74/146] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:53 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:54.067303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:54.191816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e137ee-a7b6-48d9-9aa6-bc57c73ced41 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:54.229217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:54.229873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:54.230169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:54.230427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:54.283849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:54.313434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:54.315268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:54.435189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 73/147] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:54.440880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:54.457056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:54.550403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef319-147e-43c5-a368-8a6b075782e7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:54.587834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde4c6c-99d5-4f1e-8ccf-17b371ea0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:54.588725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde4c6c-99d5-4f1e-8ccf-17b371ea0183 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:54.589010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde4c6c-99d5-4f1e-8ccf-17b371ea0183 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:54.589287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde4c6c-99d5-4f1e-8ccf-17b371ea0183 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:54.590491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde4c6c-99d5-4f1e-8ccf-17b371ea0183 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:54.591954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde4c6c-99d5-4f1e-8ccf-17b371ea0183 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:54.593669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 75/148] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:54 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:54.599471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:54.693134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:54.720667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd78b1-f4c4-4999-b6e2-e05d9a3a6345 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:54.765743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36687a0-54d0-4f8e-904a-fef2d4cb9658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:54.766421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36687a0-54d0-4f8e-904a-fef2d4cb9658 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:54.766711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36687a0-54d0-4f8e-904a-fef2d4cb9658 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:54.766994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36687a0-54d0-4f8e-904a-fef2d4cb9658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:54.767877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36687a0-54d0-4f8e-904a-fef2d4cb9658 None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=bc2accf2ac544cc5afff8334e1ed9311) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:54.768197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36687a0-54d0-4f8e-904a-fef2d4cb9658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:54.769660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36687a0-54d0-4f8e-904a-fef2d4cb9658 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:54.776194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 74/149] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:54 2022] GET /identity/v3/role_assignments?user.id=bc2accf2ac544cc5afff8334e1ed9311&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:55.829376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38db55-1364-4311-8205-da66c8fb87b3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:55.829871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38db55-1364-4311-8205-da66c8fb87b3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:55.829871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38db55-1364-4311-8205-da66c8fb87b3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:55.831467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 76/150] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:55.849765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaad93-29bd-4bc0-b41a-739234295756 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:55.851278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaad93-29bd-4bc0-b41a-739234295756 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:55.851780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaad93-29bd-4bc0-b41a-739234295756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:55.876564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-cceaad93-29bd-4bc0-b41a-739234295756 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:55.878104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cceaad93-29bd-4bc0-b41a-739234295756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:55.973429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 75/151] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:55.990623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacffe46-3b83-491a-83aa-d3e91806c5cf None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:55.991452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacffe46-3b83-491a-83aa-d3e91806c5cf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:55.991756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacffe46-3b83-491a-83aa-d3e91806c5cf None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:55.993150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 77/152] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:55.998535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b364-65e9-421d-8522-2944640186ad None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:55.998835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b364-65e9-421d-8522-2944640186ad None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:55.999116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b364-65e9-421d-8522-2944640186ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.009945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacffe46-3b83-491a-83aa-d3e91806c5cf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:56.019214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-8724b364-65e9-421d-8522-2944640186ad None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:56.028054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8724b364-65e9-421d-8522-2944640186ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:56.176395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:56.193726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 76/153] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:56.195596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f213dc-ed24-4abd-b7e4-dd81a277e751 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.195886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f213dc-ed24-4abd-b7e4-dd81a277e751 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.196173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f213dc-ed24-4abd-b7e4-dd81a277e751 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.197489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 77/154] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:56.207937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:56.208856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c74c1e-afcd-404c-a580-e3de4a816bfb None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.209144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c74c1e-afcd-404c-a580-e3de4a816bfb None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.209424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c74c1e-afcd-404c-a580-e3de4a816bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.240124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacffe46-3b83-491a-83aa-d3e91806c5cf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:56.251799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-62c74c1e-afcd-404c-a580-e3de4a816bfb None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:56.253071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-62c74c1e-afcd-404c-a580-e3de4a816bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:56.296914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:56.298113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.298607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.299103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.310976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:56.319721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:56.320650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:55:56.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:56.323871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 78/155] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:55:56.324887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:56.378916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 78/156] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:56.386732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c74c1e-afcd-404c-a580-e3de4a816bfb None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:56.510092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b016-a69e-4937-9071-f09052b728b6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:56.539673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c74c1e-afcd-404c-a580-e3de4a816bfb None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:56.554451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:56.555762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.556156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.556538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.566869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:56.571624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:56.578078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44cebd-0459-47a9-bf3b-659f410aa8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:56.578921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44cebd-0459-47a9-bf3b-659f410aa8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.579366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44cebd-0459-47a9-bf3b-659f410aa8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.579832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44cebd-0459-47a9-bf3b-659f410aa8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.580785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44cebd-0459-47a9-bf3b-659f410aa8c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:56.581243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44cebd-0459-47a9-bf3b-659f410aa8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:56.581741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:56.582841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:56.583753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 79/157] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:56.584409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:56.586562 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44cebd-0459-47a9-bf3b-659f410aa8c7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:56.591891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:56.599271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 79/158] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:56.605947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35892c-39e4-4efb-afa9-2a14d7091177 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.606522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35892c-39e4-4efb-afa9-2a14d7091177 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.606982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35892c-39e4-4efb-afa9-2a14d7091177 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.608573 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 80/159] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:56.609434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35892c-39e4-4efb-afa9-2a14d7091177 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:56.719188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35892c-39e4-4efb-afa9-2a14d7091177 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:56.725049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a6a8-aa85-4c0f-a804-fbd082413df7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:56.773529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:56.774685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.775219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.775749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.798456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:56.810930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:56.811890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:55:56.812760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:56.820030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92448c6-df4a-44fa-8399-961a4c6e8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:56.821118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92448c6-df4a-44fa-8399-961a4c6e8c3a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.821609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92448c6-df4a-44fa-8399-961a4c6e8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.822162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92448c6-df4a-44fa-8399-961a4c6e8c3a None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.823157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92448c6-df4a-44fa-8399-961a4c6e8c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:56.823717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 80/160] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:56.824858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:56.825403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92448c6-df4a-44fa-8399-961a4c6e8c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:56.827607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92448c6-df4a-44fa-8399-961a4c6e8c3a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:56.847378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 81/161] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:56.853270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333009ae-fe0b-453f-ab5b-a2e775ba2b33 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:56.854404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333009ae-fe0b-453f-ab5b-a2e775ba2b33 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:56.856116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333009ae-fe0b-453f-ab5b-a2e775ba2b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:56.896595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-333009ae-fe0b-453f-ab5b-a2e775ba2b33 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:56.897937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-333009ae-fe0b-453f-ab5b-a2e775ba2b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:56.921641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:56.975808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f75b2-45a8-4dec-8f97-ef80b39f7e46 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:56.982929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:57.022519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.023396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.023771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.023992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] PATH_INFO: `/v3/users/7e244ddf75fe49ffb887b37e16dac59f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.024933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 82/162] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:57.025479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] RBAC: Authorizing `identity:get_user(user_id=7e244ddf75fe49ffb887b37e16dac59f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:57.026458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333009ae-fe0b-453f-ab5b-a2e775ba2b33 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.027000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:57.028947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 81/163] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:56 2022] GET /identity/v3/users/7e244ddf75fe49ffb887b37e16dac59f => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:57.029712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.184437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f74e7-1b3b-45d3-9b50-0ddc44f241b3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.241812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333009ae-fe0b-453f-ab5b-a2e775ba2b33 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.243939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:57.261227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.262120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.262408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.262687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] PATH_INFO: `/v3/users/657ce8ca189845ff90a9f70d2e00122f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.268381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] RBAC: Authorizing `identity:get_user(user_id=657ce8ca189845ff90a9f70d2e00122f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:57.269866 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:57.271770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 82/164] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/users/657ce8ca189845ff90a9f70d2e00122f => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:57.272365 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.283091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.283722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.284008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.284285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.285104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:57.285410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:57.287036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:57.297501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 83/165] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:57.298393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.351261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:57.410026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daddc9-48af-4c31-9b3b-a954a6efa368 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.451231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.452138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.452819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.453170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.464971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:57.473467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:57.474426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 84/166] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:57.476842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.539063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1aa09-1209-4e86-83fc-1e56a0bab9ac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.585780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235928-c76b-4092-a4fb-44602dcb7cfa None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.604024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:57.616915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.617866 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.618150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.618428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.624317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:57.625786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:57.625986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.626528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.626815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.627091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.627758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 83/167] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:57.628326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.708843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:57.731621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:57.733336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:57.761802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f400a-8207-4fdb-b431-330769456b46 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.810798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.811627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.811916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.812192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.813415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:57.814874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:57.816749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 84/168] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:57.822320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.844449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 85/169] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:57.845546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:57.857899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:57.930155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64611f1-c00e-4270-84cb-df01e68654cc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.957182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745d42-0fcf-4522-87e6-0caa9655f5c9 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:57.963174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:57.969817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6089ca-5546-4dda-a944-e71bf38ea79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:57.970849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6089ca-5546-4dda-a944-e71bf38ea79f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.971347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6089ca-5546-4dda-a944-e71bf38ea79f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.971879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6089ca-5546-4dda-a944-e71bf38ea79f None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.972880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6089ca-5546-4dda-a944-e71bf38ea79f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:57.973367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6089ca-5546-4dda-a944-e71bf38ea79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:57.975855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6089ca-5546-4dda-a944-e71bf38ea79f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:57.985403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 85/170] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:57.987145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167b5b-de3d-4087-9262-549e0b92ed46 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.987440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167b5b-de3d-4087-9262-549e0b92ed46 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.987748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167b5b-de3d-4087-9262-549e0b92ed46 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.989014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 86/171] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:57.990244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae788-7dc2-4a78-8c5c-8867d6321a1f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:57.990535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae788-7dc2-4a78-8c5c-8867d6321a1f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:57.991452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae788-7dc2-4a78-8c5c-8867d6321a1f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:57.995619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 87/172] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:57.995619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae788-7dc2-4a78-8c5c-8867d6321a1f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.002335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:58.003243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.003532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.003849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75/users/7e244ddf75fe49ffb887b37e16dac59f/roles/e7fde74e8a8d4b729df16195b4c76439` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.005841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] RBAC: Authorizing `identity:create_grant(project_id=175a398948844db0b21c22ce03469d75, user_id=7e244ddf75fe49ffb887b37e16dac59f, role_id=e7fde74e8a8d4b729df16195b4c76439)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:58.007896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:58.021042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 86/173] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:55:57 2022] PUT /identity/v3/projects/175a398948844db0b21c22ce03469d75/users/7e244ddf75fe49ffb887b37e16dac59f/roles/e7fde74e8a8d4b729df16195b4c76439 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:55:58.022807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.121708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:58.134591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae788-7dc2-4a78-8c5c-8867d6321a1f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:58.164984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ff86-9592-4c65-969a-cf222d7680cb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:58.184887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556d6cd-ab33-4a15-8906-4ee505d049e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:58.185958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556d6cd-ab33-4a15-8906-4ee505d049e8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.186243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556d6cd-ab33-4a15-8906-4ee505d049e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.186577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556d6cd-ab33-4a15-8906-4ee505d049e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.217888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:58.219506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.219506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.219506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.220765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:58.222388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:58.224051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 87/174] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:58 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:58.224917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.269389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:58.278363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556d6cd-ab33-4a15-8906-4ee505d049e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:58.280234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556d6cd-ab33-4a15-8906-4ee505d049e8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:58.351228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f55e-542f-40d3-ad4b-69b9549661cf None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:58.393577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620447b-7633-49b3-aa2a-a7e0ce81b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:58.396584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620447b-7633-49b3-aa2a-a7e0ce81b02b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.396584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620447b-7633-49b3-aa2a-a7e0ce81b02b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.396584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620447b-7633-49b3-aa2a-a7e0ce81b02b None admin] PATH_INFO: `/v3/users/bc2accf2ac544cc5afff8334e1ed9311` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.399837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620447b-7633-49b3-aa2a-a7e0ce81b02b None admin] RBAC: Authorizing `identity:get_user(user_id=bc2accf2ac544cc5afff8334e1ed9311)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:58.401407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620447b-7633-49b3-aa2a-a7e0ce81b02b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:58.407504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 88/175] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:58 2022] GET /identity/v3/users/bc2accf2ac544cc5afff8334e1ed9311 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:58.407504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef181361-6435-4c8f-9482-83de67117dc5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.407504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef181361-6435-4c8f-9482-83de67117dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.407504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef181361-6435-4c8f-9482-83de67117dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.408915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 88/176] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:58.410528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee80d-c7b4-40a7-a088-fb611cac1b92 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.410966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee80d-c7b4-40a7-a088-fb611cac1b92 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.411856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:58.412299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee80d-c7b4-40a7-a088-fb611cac1b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.429330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ef181361-6435-4c8f-9482-83de67117dc5 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:58.431032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ef181361-6435-4c8f-9482-83de67117dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:58.431853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8bfee80d-c7b4-40a7-a088-fb611cac1b92 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:58.433321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8bfee80d-c7b4-40a7-a088-fb611cac1b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:58.504985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 89/177] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:58.505539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 89/178] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:58.507151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfee80d-c7b4-40a7-a088-fb611cac1b92 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.512457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef181361-6435-4c8f-9482-83de67117dc5 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.546706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:58.632781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef181361-6435-4c8f-9482-83de67117dc5 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:58.634191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfee80d-c7b4-40a7-a088-fb611cac1b92 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:58.664596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:58.670568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:58.671231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.671448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:58.671589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.671810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.672139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.672429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.672655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=657ce8ca189845ff90a9f70d2e00122f) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:58.672757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.672969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:58.674612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:58.683893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 90/179] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:58 2022] GET /identity/v3/role_assignments?user.id=657ce8ca189845ff90a9f70d2e00122f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:58.685563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.756199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:58.758255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:58.793893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:58.829408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521d777-fd8e-42d9-a734-e33a34177d86 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:58.871507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffcd7d-0412-4e61-9e5d-b67930d45597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:58.872552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffcd7d-0412-4e61-9e5d-b67930d45597 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.872840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffcd7d-0412-4e61-9e5d-b67930d45597 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.873239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffcd7d-0412-4e61-9e5d-b67930d45597 None admin] PATH_INFO: `/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.874446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffcd7d-0412-4e61-9e5d-b67930d45597 None admin] RBAC: Authorizing `identity:get_project(project_id=38fec128f6cf47e3b0f9ac41f9ad5f11)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:58.876093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffcd7d-0412-4e61-9e5d-b67930d45597 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:58.877810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 91/180] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:58 2022] GET /identity/v3/projects/38fec128f6cf47e3b0f9ac41f9ad5f11 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:58.879116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d5ae6-11e9-4a1e-a609-48e57e95f717 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:58.879457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d5ae6-11e9-4a1e-a609-48e57e95f717 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:58.879763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d5ae6-11e9-4a1e-a609-48e57e95f717 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:58.881089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 92/181] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:55:58.886076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d5ae6-11e9-4a1e-a609-48e57e95f717 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.895974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 90/182] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:55:58.897746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:58.963609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.010086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d5ae6-11e9-4a1e-a609-48e57e95f717 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.014777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373798c-8718-4b26-b1ca-fc4d06076b00 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.038369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.050404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.051224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.051511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.051818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.052316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7097a-1cf0-41e9-9f93-39ce18cf3337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.053630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7097a-1cf0-41e9-9f93-39ce18cf3337 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.054165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7097a-1cf0-41e9-9f93-39ce18cf3337 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.054503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7097a-1cf0-41e9-9f93-39ce18cf3337 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.063234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:59.064874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7097a-1cf0-41e9-9f93-39ce18cf3337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:59.072011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:59.072931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:55:59.073750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 91/183] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:55:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:59.074408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-bbb7097a-1cf0-41e9-9f93-39ce18cf3337 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:55:59.079353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:55:59.080308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:55:59.081123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 93/184] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:55:59.081795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe0f1a-62b7-4a69-8374-caa96a313b8b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.081795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe0f1a-62b7-4a69-8374-caa96a313b8b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.081911 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe0f1a-62b7-4a69-8374-caa96a313b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.098407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-eabe0f1a-62b7-4a69-8374-caa96a313b8b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:55:59.099619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-eabe0f1a-62b7-4a69-8374-caa96a313b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:55:59.165402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 94/185] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:55:59.168478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe0f1a-62b7-4a69-8374-caa96a313b8b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.191983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a415e-672e-49fe-9208-d4320cd6699a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.232151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.232755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.233038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.233175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.233375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.234170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=38fec128f6cf47e3b0f9ac41f9ad5f11, user.id=bc2accf2ac544cc5afff8334e1ed9311) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:59.234578 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.236605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.243500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 92/186] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/role_assignments?user.id=bc2accf2ac544cc5afff8334e1ed9311&scope.project.id=38fec128f6cf47e3b0f9ac41f9ad5f11&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.244340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.299772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe0f1a-62b7-4a69-8374-caa96a313b8b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.304196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.349190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.350680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.351191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.352075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.353688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.356031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.358546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 95/187] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.359649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.374489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abe907-e565-45d8-90f5-61ca711aec26 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.422868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.423684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.424041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.424481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.425260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:59.425573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.426981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.439097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 93/188] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.439849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.510688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7127a-4330-4a4c-93f8-bfd67c160192 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.539543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.553077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.554138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.554380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.554697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.555495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:59.555977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.557325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.558724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282026ca-64e2-4d53-a61c-80214109223d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.566428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 96/189] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.567851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.577940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.605849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.606661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.606948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.607223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.608575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.610020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.611675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 94/190] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.612448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.705960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f89f9-90ff-48c5-a21e-0b7bea97ef9b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.724035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918571b9-880e-49b6-aff2-1dd85904b6fc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.756151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.756963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.757245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.757526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.758376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] RBAC: Adding query filter params (role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=bc2accf2ac544cc5afff8334e1ed9311) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:55:59.758831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.760180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.766951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 97/191] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/role_assignments?user.id=bc2accf2ac544cc5afff8334e1ed9311&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.767167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.767551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.768121 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.768412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.768687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] PATH_INFO: `/v3/users/cbf7812b65c042e287aecd8bb9800e5d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.784826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7812b65c042e287aecd8bb9800e5d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.786500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.789297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 95/192] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/users/cbf7812b65c042e287aecd8bb9800e5d => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.790001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.830894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.846498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:55:59.908238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f719-6df3-4bd8-b6cf-277d8aea1ebe None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.920536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e259b7d-0ff6-4e3e-a466-de17db5f5222 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:55:59.958759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.959493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.959824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.960106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.960837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.962310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.969612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:55:59.970750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:55:59.971274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:55:59.972123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] PATH_INFO: `/v3/users/cbf7812b65c042e287aecd8bb9800e5d` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:55:59.973728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7812b65c042e287aecd8bb9800e5d)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:55:59.975536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:55:59.977375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 98/193] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/users/cbf7812b65c042e287aecd8bb9800e5d => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:55:59.978266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:55:59.990452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 96/194] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:55:59 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:55:59.992566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:00.106223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:00.118699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a8e33-0df2-427a-9a15-bfa7933e2c75 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:00.119081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7085a-193d-467c-a339-5bbaca90991b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:00.138383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:00.161841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1aa0b-ebba-4151-b1ce-d31f94a6f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:00.163068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1aa0b-ebba-4151-b1ce-d31f94a6f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.163363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1aa0b-ebba-4151-b1ce-d31f94a6f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.163695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1aa0b-ebba-4151-b1ce-d31f94a6f5e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.163826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b851-8ceb-4816-95c0-867c1ee2b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:00.164636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b851-8ceb-4816-95c0-867c1ee2b20d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.165065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b851-8ceb-4816-95c0-867c1ee2b20d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.165480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b851-8ceb-4816-95c0-867c1ee2b20d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.242482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1aa0b-ebba-4151-b1ce-d31f94a6f5e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:00.244026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1aa0b-ebba-4151-b1ce-d31f94a6f5e5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:00.246261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45b851-8ceb-4816-95c0-867c1ee2b20d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:00.247775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45b851-8ceb-4816-95c0-867c1ee2b20d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:00.375859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:00.383235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 99/195] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:00.384765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea6fe-d2d3-4720-9c90-dd88128ab1b5 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.384765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea6fe-d2d3-4720-9c90-dd88128ab1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.384765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea6fe-d2d3-4720-9c90-dd88128ab1b5 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.386381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 100/196] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:00.387228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea6fe-d2d3-4720-9c90-dd88128ab1b5 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:00.400248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 97/197] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:00.403142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f170785-f43a-46e1-99a3-cc77eb78f221 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.403900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f170785-f43a-46e1-99a3-cc77eb78f221 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.404623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f170785-f43a-46e1-99a3-cc77eb78f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.411879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:00.427315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7f170785-f43a-46e1-99a3-cc77eb78f221 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:00.429948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7f170785-f43a-46e1-99a3-cc77eb78f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:00.510200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea6fe-d2d3-4720-9c90-dd88128ab1b5 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:00.524333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 98/198] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:00.526138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f170785-f43a-46e1-99a3-cc77eb78f221 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:00.546920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:00.547890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.548167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.548489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.549669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:00.551175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:00.553303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 101/199] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:00 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:00.558798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:00.652501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f170785-f43a-46e1-99a3-cc77eb78f221 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:00.676461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:00.680539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:00.695999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:00.697678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.698175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.698643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.700066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:00.700193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5f2bd-6d84-4f15-9054-eff0fe20e6f4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:00.701942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:00.709037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 99/200] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:00 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:00.710762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:00.744877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:00.745969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.746256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.746540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.760121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:00.770540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:00.771444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:00.773136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 102/201] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:00.773799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:00.835477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71394e-71bd-4626-99dc-a516f255a1af None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:00.874445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:00.875547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.876056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.876570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.877601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] RBAC: Adding query filter params (role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=cbf7812b65c042e287aecd8bb9800e5d) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:00.878131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:00.879856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:00.886361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 100/202] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:00 2022] GET /identity/v3/role_assignments?user.id=cbf7812b65c042e287aecd8bb9800e5d&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:00.887464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:00.908001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860e653-2d70-4e27-ada4-7f1b1594de95 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:00.983895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:00.986688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:00.987763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:00.988243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:00.989743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=cbf7812b65c042e287aecd8bb9800e5d) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:00.991793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:00.993746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:01.007413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 103/203] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:00 2022] GET /identity/v3/role_assignments?user.id=cbf7812b65c042e287aecd8bb9800e5d&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:01.022450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:01.095908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dd12f-d8d0-4d68-871b-073db6c3e3d0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:01.136373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:01.137188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:01.137370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:01.137655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:01.138441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:01.138756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:01.140195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:01.150472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 101/204] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:01.156403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:01.176054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:01.264263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60137d-f540-4f15-b6df-1247a973da41 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:01.308457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:01.309351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:01.309639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:01.309917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] PATH_INFO: `/v3/users/7e244ddf75fe49ffb887b37e16dac59f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:01.311140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] RBAC: Authorizing `identity:get_user(user_id=7e244ddf75fe49ffb887b37e16dac59f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:01.312632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:01.314292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 104/205] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:01 2022] GET /identity/v3/users/7e244ddf75fe49ffb887b37e16dac59f => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:01.320539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:01.436278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cd9d4-e9e3-48b6-803e-60083f7d1569 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:01.454396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:01.475653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:01.475653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:01.476048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:01.476217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:01.549425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:01.550906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:01.657754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 102/206] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:01.663628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:01.797180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:01.837955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9ecd-e149-4d13-8ac8-fea890628be0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:01.886841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c7bda-fcbc-4a83-b876-0a2ad6704017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:01.887757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c7bda-fcbc-4a83-b876-0a2ad6704017 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:01.888038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c7bda-fcbc-4a83-b876-0a2ad6704017 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:01.888314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c7bda-fcbc-4a83-b876-0a2ad6704017 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:01.889528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c7bda-fcbc-4a83-b876-0a2ad6704017 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:01.890986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c7bda-fcbc-4a83-b876-0a2ad6704017 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:01.892899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 105/207] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:01 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:01.904679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:01.951498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:02.073726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c2828-7403-4ca3-9e7a-b381b0dbb2e9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:02.123516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e582c-4a52-40f1-8263-783e020633a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:02.127239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e582c-4a52-40f1-8263-783e020633a5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:02.127540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e582c-4a52-40f1-8263-783e020633a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:02.127850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e582c-4a52-40f1-8263-783e020633a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:02.128719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e582c-4a52-40f1-8263-783e020633a5 None admin] RBAC: Adding query filter params (role.id=e7fde74e8a8d4b729df16195b4c76439, scope.project.id=175a398948844db0b21c22ce03469d75, user.id=7e244ddf75fe49ffb887b37e16dac59f) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:02.129040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e582c-4a52-40f1-8263-783e020633a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:02.130510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e582c-4a52-40f1-8263-783e020633a5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:02.143986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 103/208] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:01 2022] GET /identity/v3/role_assignments?user.id=7e244ddf75fe49ffb887b37e16dac59f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=e7fde74e8a8d4b729df16195b4c76439 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:02.709653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7869-5742-400f-9e25-45c1bcc6eb11 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:02.710192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7869-5742-400f-9e25-45c1bcc6eb11 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:02.710192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7869-5742-400f-9e25-45c1bcc6eb11 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:02.711605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 106/209] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:02.716906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f78a52-004d-483d-954f-1961a405d73a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:02.717203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f78a52-004d-483d-954f-1961a405d73a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:02.717493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f78a52-004d-483d-954f-1961a405d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:02.737237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-23f78a52-004d-483d-954f-1961a405d73a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:02.738744 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-23f78a52-004d-483d-954f-1961a405d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:02.745095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2d3f3-7a28-454f-a759-fce773abcaa1 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:02.745387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2d3f3-7a28-454f-a759-fce773abcaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:02.745666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2d3f3-7a28-454f-a759-fce773abcaa1 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:02.747061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 107/210] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:02.753367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eefc2e-64c5-4a8e-8d12-4d973e832212 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:02.753667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eefc2e-64c5-4a8e-8d12-4d973e832212 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:02.753952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eefc2e-64c5-4a8e-8d12-4d973e832212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:02.775262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-27eefc2e-64c5-4a8e-8d12-4d973e832212 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:02.776787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-27eefc2e-64c5-4a8e-8d12-4d973e832212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:02.812939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 104/211] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:02.841503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f78a52-004d-483d-954f-1961a405d73a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:02.852104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 108/212] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:02.868083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:02.879870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eefc2e-64c5-4a8e-8d12-4d973e832212 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:02.952039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f78a52-004d-483d-954f-1961a405d73a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:02.963928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:02.988672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:02.989631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:02.990070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:02.991012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:02.993216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eefc2e-64c5-4a8e-8d12-4d973e832212 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:03.001832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:03.010409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:03.011460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:03.012485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:03.014292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 105/213] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:03.020278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.035404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:03.036598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.036891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.037192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.038706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:03.040515 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:03.043367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 109/214] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:03.048158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.112331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:03.146051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5c293-6400-46ed-a9a8-9cbe0513b78c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:03.171414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fb7e7-c10c-4c58-8f13-ab70d38d26f4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:03.182590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:03.183703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.183703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.184048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.184876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:03.185272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:03.186905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:03.200674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 106/215] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:03.201710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.219107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7e46f-f05d-4a19-b410-f0e72456fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:03.220174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7e46f-f05d-4a19-b410-f0e72456fe0e None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.220462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7e46f-f05d-4a19-b410-f0e72456fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.220738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7e46f-f05d-4a19-b410-f0e72456fe0e None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.221766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7e46f-f05d-4a19-b410-f0e72456fe0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:03.223239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7e46f-f05d-4a19-b410-f0e72456fe0e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:03.243505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:03.252053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 110/216] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:03 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:03.333086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d12b-c9a0-45a4-a001-ca5cde5c8c6b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:03.368063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:03.373518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:03.374622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.374905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.375183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] PATH_INFO: `/v3/users/fe1a0fb0b11e44d8b28517cb5b210ca2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.391184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1a0fb0b11e44d8b28517cb5b210ca2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:03.393075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:03.394006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfda66-6baa-4e01-ada3-7a6dffc0c2ec None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.394505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfda66-6baa-4e01-ada3-7a6dffc0c2ec None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.394878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 107/217] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:03 2022] GET /identity/v3/users/fe1a0fb0b11e44d8b28517cb5b210ca2 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:03.395197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfda66-6baa-4e01-ada3-7a6dffc0c2ec None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.397267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 111/218] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:56:03.400731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.403875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449268d-732f-42e0-8f9a-0c13e4c4c121 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.404399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449268d-732f-42e0-8f9a-0c13e4c4c121 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.405800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449268d-732f-42e0-8f9a-0c13e4c4c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.427619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e449268d-732f-42e0-8f9a-0c13e4c4c121 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:03.430020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e449268d-732f-42e0-8f9a-0c13e4c4c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:03.511060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 112/219] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:03.527017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78a0f5-42ad-4d11-becf-8aaf33f5ee89 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:03.534117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449268d-732f-42e0-8f9a-0c13e4c4c121 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.574990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab445e-06e4-44d0-bd29-600aa74580ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:03.577128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab445e-06e4-44d0-bd29-600aa74580ab None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.577472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab445e-06e4-44d0-bd29-600aa74580ab None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.577810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab445e-06e4-44d0-bd29-600aa74580ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.660715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:03.670075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449268d-732f-42e0-8f9a-0c13e4c4c121 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:03.677413 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab445e-06e4-44d0-bd29-600aa74580ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:03.682010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab445e-06e4-44d0-bd29-600aa74580ab None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:03.704741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:03.713775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251887-5007-472c-a138-66f3cac2962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:03.714813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251887-5007-472c-a138-66f3cac2962d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.715100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251887-5007-472c-a138-66f3cac2962d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.715380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251887-5007-472c-a138-66f3cac2962d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.730517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3251887-5007-472c-a138-66f3cac2962d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-c3251887-5007-472c-a138-66f3cac2962d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:03.742207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:03.743195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:03.744035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 113/220] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:03.747768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bf3dc-a6b9-4981-9d3f-877cfb6c4712 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.747768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bf3dc-a6b9-4981-9d3f-877cfb6c4712 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.747768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bf3dc-a6b9-4981-9d3f-877cfb6c4712 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.747768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 114/221] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:03.754050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bf3dc-a6b9-4981-9d3f-877cfb6c4712 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.816915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 108/222] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:03.818525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a5f66-2c48-477e-834c-74fbc6efb266 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.819659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a5f66-2c48-477e-834c-74fbc6efb266 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.819949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a5f66-2c48-477e-834c-74fbc6efb266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.840507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-083a5f66-2c48-477e-834c-74fbc6efb266 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:03.841704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-083a5f66-2c48-477e-834c-74fbc6efb266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:03.869214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bf3dc-a6b9-4981-9d3f-877cfb6c4712 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:03.909181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:03.909909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:03.910192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:03.910596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:03.911418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:03.911759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:03.913333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:03.923263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 115/223] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:03.924254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.924522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 109/224] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:03.929260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a5f66-2c48-477e-834c-74fbc6efb266 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:03.961708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:04.013349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:04.061677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a5f66-2c48-477e-834c-74fbc6efb266 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.076777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3105f-ae91-466a-b517-f95c0c6f46f3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.099711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.100607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.100894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.101174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] PATH_INFO: `/v3/users/cbf7812b65c042e287aecd8bb9800e5d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.102449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7812b65c042e287aecd8bb9800e5d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:04.104055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:04.111063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 110/225] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:03 2022] GET /identity/v3/users/cbf7812b65c042e287aecd8bb9800e5d => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:04.111063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:04.120165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.121365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.121846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.122337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.123771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:04.125430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:04.127668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 116/226] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:03 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:04.128759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:04.210406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:04.224557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d195e-8a9d-415c-bd5a-5afb847201a6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.237899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b80bb4-d4d3-4d95-aebc-c70faa45e02c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.260433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:04.264601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.265236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.265523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.265799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.278367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:04.280475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.281556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.282050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.282519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.283933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:04.285570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:04.286093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:04.286962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:04.287860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:04.290452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 117/228] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:04 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:04.295374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 111/228] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:04.295374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:04.296651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:04.409657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353cc37-44a4-4e28-91ec-345506ab93b2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.410648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a916764-13f8-4f49-a6ff-c79214cce8ec None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.449563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.450233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.450518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.450800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.451339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.451675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=fe1a0fb0b11e44d8b28517cb5b210ca2) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:04.451999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:04.452927 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.453398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.453499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:04.453945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/cbf7812b65c042e287aecd8bb9800e5d/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.456615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c752f18e50e43f0a2ee057c963e0fa2, user_id=cbf7812b65c042e287aecd8bb9800e5d, role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:04.458272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:04.459783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 112/229] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:04 2022] GET /identity/v3/role_assignments?user.id=fe1a0fb0b11e44d8b28517cb5b210ca2&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:04.460768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:04.475328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 118/230] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:04 2022] PUT /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/cbf7812b65c042e287aecd8bb9800e5d/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:04.481513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:04.585206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206a6e-7903-428a-bb71-9699655ba895 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.625576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.626290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.626578 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.626854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.627693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:04.628008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:04.629496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:04.641781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 113/231] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:04.648843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:04.711190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:04.784559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdfc1c-a5cc-450e-b6dc-c591f92cd364 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:04.826157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:04.827048 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:04.827330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:04.827630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] PATH_INFO: `/v3/users/cbf7812b65c042e287aecd8bb9800e5d` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:04.828857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7812b65c042e287aecd8bb9800e5d)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:04.830299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:04.832215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 119/232] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:04 2022] GET /identity/v3/users/cbf7812b65c042e287aecd8bb9800e5d => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:04.837704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:04.952552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:04.980652 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6d51b-6c31-434f-b5ba-c479ca4f90ac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:05.029879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04c09-f865-465e-8c0e-5d95306eea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:05.031094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04c09-f865-465e-8c0e-5d95306eea6f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:05.031553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04c09-f865-465e-8c0e-5d95306eea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:05.032049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04c09-f865-465e-8c0e-5d95306eea6f None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:05.033404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04c09-f865-465e-8c0e-5d95306eea6f None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:05.035020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04c09-f865-465e-8c0e-5d95306eea6f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:05.036955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 114/233] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:04 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:05.044787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:05.196083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d8b1b-b1cb-4c10-861b-51e3ecea54eb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:05.213402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:05.238498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4105bc3-8cca-46e9-8dd3-28cad63f472b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:05.239334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4105bc3-8cca-46e9-8dd3-28cad63f472b None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:05.239642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4105bc3-8cca-46e9-8dd3-28cad63f472b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:05.239979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4105bc3-8cca-46e9-8dd3-28cad63f472b None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/cbf7812b65c042e287aecd8bb9800e5d/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:05.242773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4105bc3-8cca-46e9-8dd3-28cad63f472b None admin] RBAC: Authorizing `identity:create_grant(project_id=2c752f18e50e43f0a2ee057c963e0fa2, user_id=cbf7812b65c042e287aecd8bb9800e5d, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:05.244258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4105bc3-8cca-46e9-8dd3-28cad63f472b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:05.283844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 120/234] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:05 2022] PUT /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/cbf7812b65c042e287aecd8bb9800e5d/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:05.715003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d256fe-6f56-4052-8816-3b7e492bf15f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:05.715550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d256fe-6f56-4052-8816-3b7e492bf15f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:05.715550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d256fe-6f56-4052-8816-3b7e492bf15f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:05.716970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 115/235] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:05.726106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4884c-f3db-492d-b3a4-3ac04cbfc148 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:05.726106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4884c-f3db-492d-b3a4-3ac04cbfc148 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:05.726106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4884c-f3db-492d-b3a4-3ac04cbfc148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:05.748662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a7e4884c-f3db-492d-b3a4-3ac04cbfc148 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:05.750222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a7e4884c-f3db-492d-b3a4-3ac04cbfc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:05.783433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826861c-22f9-44dd-aa3a-6936450c4a67 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:05.783755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826861c-22f9-44dd-aa3a-6936450c4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:05.784027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826861c-22f9-44dd-aa3a-6936450c4a67 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:05.785661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 116/236] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:05.792301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903750-2c37-4c14-8884-27e82c5810ce None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:05.792587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903750-2c37-4c14-8884-27e82c5810ce None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:05.792863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903750-2c37-4c14-8884-27e82c5810ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:05.813395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e6903750-2c37-4c14-8884-27e82c5810ce None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:05.813395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e6903750-2c37-4c14-8884-27e82c5810ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:05.855489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 121/237] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:05.879379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4884c-f3db-492d-b3a4-3ac04cbfc148 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:05.946241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 117/238] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:06.013533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4884c-f3db-492d-b3a4-3ac04cbfc148 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:06.016024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:06.028666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903750-2c37-4c14-8884-27e82c5810ce None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:06.050940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:06.051778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:06.052062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:06.052335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:06.072236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:06.084254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:06.085175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:06.085983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:06.089286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 122/239] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:06.095084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:06.174341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:06.237952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903750-2c37-4c14-8884-27e82c5810ce None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:06.247662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8fddc-824b-403b-9d5c-b3c058bcc986 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:06.282833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:06.283590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:06.283900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:06.284179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:06.284997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:06.285314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:06.286714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:06.295922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 123/240] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:06.302403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:06.332037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:06.340395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:06.341144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:06.341426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:06.341846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:06.346746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:06.348366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:06.351091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 118/241] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:06.356221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:06.410051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb7b4-174c-44df-a636-af9a8665c336 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:06.447933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:06.449172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:06.449510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:06.449798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] PATH_INFO: `/v3/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:06.464793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] RBAC: Authorizing `identity:get_user(user_id=76f2dea88ddb4cf1b13b8ca7ff6a8c85)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:06.467059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:06.469169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 124/242] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:06 2022] GET /identity/v3/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:06.474808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:06.580001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:06.582267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a370da-2746-4fc2-a50b-c7d192bdb931 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:06.586903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2bc6-4924-4223-96cb-b01d82f31024 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:06.629399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40beae8-1971-43a6-8dbd-2be2cbbebfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:06.630053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40beae8-1971-43a6-8dbd-2be2cbbebfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:06.630339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40beae8-1971-43a6-8dbd-2be2cbbebfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:06.630618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40beae8-1971-43a6-8dbd-2be2cbbebfb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:06.669051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:06.669733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:06.670017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:06.670294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:06.671068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:06.672538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:06.695970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:06.717144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 119/243] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:06 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:06.746430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40beae8-1971-43a6-8dbd-2be2cbbebfb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:06.747960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40beae8-1971-43a6-8dbd-2be2cbbebfb6 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:06.843129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:06.862852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 125/244] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:06.869105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:06.998020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569f670-7806-4ae9-8099-6075f73ae255 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:07.024510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718649b3-1c14-4a77-93ea-ddf48424385d None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.024819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718649b3-1c14-4a77-93ea-ddf48424385d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.025080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718649b3-1c14-4a77-93ea-ddf48424385d None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.028638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 126/245] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:07.032810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b004382-2481-4554-9a6d-4df56d5d5a4f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.033094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b004382-2481-4554-9a6d-4df56d5d5a4f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.033369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b004382-2481-4554-9a6d-4df56d5d5a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.040526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:07.042282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.042573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.042918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.044272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:07.045792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:07.048309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 120/246] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:06 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:07.054977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:07.057184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-2b004382-2481-4554-9a6d-4df56d5d5a4f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:07.058388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2b004382-2481-4554-9a6d-4df56d5d5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:07.140465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:07.152110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 127/247] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:07.191299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b343a-3bc9-4361-99fd-4757ebac7a85 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:07.196970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b004382-2481-4554-9a6d-4df56d5d5a4f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:07.236930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a80ea-ae30-4dd1-9007-3bf4d16c8aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:07.237662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a80ea-ae30-4dd1-9007-3bf4d16c8aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.237953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a80ea-ae30-4dd1-9007-3bf4d16c8aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.238234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a80ea-ae30-4dd1-9007-3bf4d16c8aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.239136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a80ea-ae30-4dd1-9007-3bf4d16c8aa8 None admin] RBAC: Adding query filter params (role.id=e7fde74e8a8d4b729df16195b4c76439, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=76f2dea88ddb4cf1b13b8ca7ff6a8c85) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:07.239458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a80ea-ae30-4dd1-9007-3bf4d16c8aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:07.243190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a80ea-ae30-4dd1-9007-3bf4d16c8aa8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:07.250142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 121/248] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:07 2022] GET /identity/v3/role_assignments?user.id=76f2dea88ddb4cf1b13b8ca7ff6a8c85&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=e7fde74e8a8d4b729df16195b4c76439 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:07.312690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb071-8b07-4755-9514-41fd70a59fb7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.312999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb071-8b07-4755-9514-41fd70a59fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.313259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb071-8b07-4755-9514-41fd70a59fb7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.314883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 122/249] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:56:07.323030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d3460-a39a-4019-b514-353db6359726 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.323357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d3460-a39a-4019-b514-353db6359726 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.323686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d3460-a39a-4019-b514-353db6359726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.338127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b004382-2481-4554-9a6d-4df56d5d5a4f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:07.349398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1c9d3460-a39a-4019-b514-353db6359726 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:07.351214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1c9d3460-a39a-4019-b514-353db6359726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:07.367967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:07.401726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:07.403043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.403872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.404334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.419635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:07.431988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:07.432943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:07.433750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:07.437071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 128/250] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:07.445255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:07.473456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 123/251] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:07.507632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d3460-a39a-4019-b514-353db6359726 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:07.583748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:07.585477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c74d-cc51-4728-8668-7269f96a4543 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:07.628143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:07.628836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.629121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.629400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.630164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:07.630473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:07.631950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:07.650083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 129/252] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:07.656066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d3460-a39a-4019-b514-353db6359726 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:07.673452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:07.729698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:07.732677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.732990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.733251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.739260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:07.761999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:07.771249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:07.772771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:07.773597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:07.774240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 124/253] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:07.779611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:07.897965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fa1c5-d38a-463d-9cbe-71b1ecd2e4e8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:07.938480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:07.939371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:07.939671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:07.939943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] PATH_INFO: `/v3/users/fe1a0fb0b11e44d8b28517cb5b210ca2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:07.941597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1a0fb0b11e44d8b28517cb5b210ca2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:07.943056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:07.946030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 130/254] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:07 2022] GET /identity/v3/users/fe1a0fb0b11e44d8b28517cb5b210ca2 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:07.951657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:08.001572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20524-097b-4eec-a46c-3e58c0f54c18 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:08.050303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:08.080765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb5f69-b005-48c3-b2d9-9e34f9ddbe98 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:08.087538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:08.088650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195e522-dcbf-48d1-85bc-b206df2942a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:08.089348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195e522-dcbf-48d1-85bc-b206df2942a1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.089634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195e522-dcbf-48d1-85bc-b206df2942a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.089916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195e522-dcbf-48d1-85bc-b206df2942a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.090675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195e522-dcbf-48d1-85bc-b206df2942a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:08.093453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195e522-dcbf-48d1-85bc-b206df2942a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:08.093453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195e522-dcbf-48d1-85bc-b206df2942a1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:08.115700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 125/255] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:08.118409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d582f-c76c-43ed-8b95-79c89e470c89 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.120807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d582f-c76c-43ed-8b95-79c89e470c89 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.121339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d582f-c76c-43ed-8b95-79c89e470c89 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.122951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 126/256] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:08.124971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d582f-c76c-43ed-8b95-79c89e470c89 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:08.156102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcfd85-e044-461b-a9e9-a12d3a671dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:08.156975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcfd85-e044-461b-a9e9-a12d3a671dcb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.157252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcfd85-e044-461b-a9e9-a12d3a671dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.157522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcfd85-e044-461b-a9e9-a12d3a671dcb None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.159484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcfd85-e044-461b-a9e9-a12d3a671dcb None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:08.160960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcfd85-e044-461b-a9e9-a12d3a671dcb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:08.164574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 131/257] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:07 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:08.165751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9893dd-c046-4238-b48d-a4c3be2f1b08 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.166033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9893dd-c046-4238-b48d-a4c3be2f1b08 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.166309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9893dd-c046-4238-b48d-a4c3be2f1b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.196351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-6d9893dd-c046-4238-b48d-a4c3be2f1b08 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:08.197534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6d9893dd-c046-4238-b48d-a4c3be2f1b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:08.302419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d582f-c76c-43ed-8b95-79c89e470c89 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:08.342852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 132/258] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:08.344049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9893dd-c046-4238-b48d-a4c3be2f1b08 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:08.369709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:08.370935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.371446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.371965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] PATH_INFO: `/v3/users/cbf7812b65c042e287aecd8bb9800e5d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.373483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7812b65c042e287aecd8bb9800e5d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:08.376331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:08.378950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 127/259] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:08 2022] GET /identity/v3/users/cbf7812b65c042e287aecd8bb9800e5d => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:08.384783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:08.466015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:08.534600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9893dd-c046-4238-b48d-a4c3be2f1b08 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:08.537041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:08.561054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119ef9-2c41-4858-8517-1254894e700e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:08.602394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:08.603783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.604326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.604830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/fe1a0fb0b11e44d8b28517cb5b210ca2/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.608904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c752f18e50e43f0a2ee057c963e0fa2, user_id=fe1a0fb0b11e44d8b28517cb5b210ca2, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:08.610737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:08.634940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 133/260] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:08 2022] PUT /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/fe1a0fb0b11e44d8b28517cb5b210ca2/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:08.636004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:08.637794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.638442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:08.638941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.639925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.760718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55de2-ec0c-436c-99f3-40d387170162 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:08.823724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:08.824456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:08.824740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:08.825016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:08.831601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:08.834977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:08.876265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:08.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:08.897158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:08.898520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:08.900870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 134/261] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:08.908567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:08.923315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:08.976014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:09.017152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 128/262] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:09.023816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:09.148473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de766cb2-b977-4342-9fb9-a255fa2246b0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:09.212630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16378-b5d1-4d7a-9874-b26969ffcbe2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:09.221711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:09.222746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.223496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.225020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.229033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:09.229699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:09.232509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:09.252030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 135/263] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:09.258971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:09.293054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:09.294516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.295894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.297839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.300541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:09.302212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:09.306847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 129/264] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:09 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:09.311626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:09.357731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:09.443771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:09.479552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ab759-45b8-436c-87a6-b93efebe2d50 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:09.509891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812def98-9f99-4532-a825-9e36787e76e9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:09.546365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:09.547737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.548298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.548773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] PATH_INFO: `/v3/users/cbf7812b65c042e287aecd8bb9800e5d` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.552331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf7812b65c042e287aecd8bb9800e5d)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:09.555082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:09.557061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 136/265] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:09 2022] GET /identity/v3/users/cbf7812b65c042e287aecd8bb9800e5d => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:09.559828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91fe7b-bb27-4e73-86c5-c71467d19ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:09.560497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fe7b-bb27-4e73-86c5-c71467d19ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.560782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fe7b-bb27-4e73-86c5-c71467d19ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.561059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fe7b-bb27-4e73-86c5-c71467d19ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.561904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91fe7b-bb27-4e73-86c5-c71467d19ae2 None admin] RBAC: Adding query filter params (role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=cbf7812b65c042e287aecd8bb9800e5d) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:09.562218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91fe7b-bb27-4e73-86c5-c71467d19ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:09.563775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91fe7b-bb27-4e73-86c5-c71467d19ae2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:09.567563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:09.571212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 130/266] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:09 2022] GET /identity/v3/role_assignments?user.id=cbf7812b65c042e287aecd8bb9800e5d&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:09.725955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096c01-e0ba-42e0-82b5-e318350807c0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:09.774919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97757e-295d-472a-802a-d8d119160465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:09.775602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97757e-295d-472a-802a-d8d119160465 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.775896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97757e-295d-472a-802a-d8d119160465 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.776170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97757e-295d-472a-802a-d8d119160465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.803920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a6c05-97e9-4347-9ab1-d60347a72881 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.804227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a6c05-97e9-4347-9ab1-d60347a72881 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.804485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a6c05-97e9-4347-9ab1-d60347a72881 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.806199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 131/267] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:56:09.811903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca7eb-de7f-41b0-8fbc-8321516d1061 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.812184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca7eb-de7f-41b0-8fbc-8321516d1061 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.815608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca7eb-de7f-41b0-8fbc-8321516d1061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.843649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:09.850044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-64fca7eb-de7f-41b0-8fbc-8321516d1061 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:09.851513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-64fca7eb-de7f-41b0-8fbc-8321516d1061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:09.924959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97757e-295d-472a-802a-d8d119160465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:09.926452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97757e-295d-472a-802a-d8d119160465 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:09.964934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 132/268] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:09.966365 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aec8f-ca69-4a6b-847d-86d4355bc843 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.966660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aec8f-ca69-4a6b-847d-86d4355bc843 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.967042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aec8f-ca69-4a6b-847d-86d4355bc843 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.968768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 133/269] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:09.973845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70fae-2980-4481-a435-c683a2f82619 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:09.974137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70fae-2980-4481-a435-c683a2f82619 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:09.974974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70fae-2980-4481-a435-c683a2f82619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:09.996602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-aff70fae-2980-4481-a435-c683a2f82619 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:09.997722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-aff70fae-2980-4481-a435-c683a2f82619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:10.002521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.058355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 137/270] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 09:56:10.059484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97757e-295d-472a-802a-d8d119160465 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.103605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 134/271] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:10.103605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff70fae-2980-4481-a435-c683a2f82619 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.143058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.208545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97757e-295d-472a-802a-d8d119160465 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.222889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff70fae-2980-4481-a435-c683a2f82619 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.257701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.258425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.258710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.258992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.265348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.266680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.267420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.268281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.269689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:10.270720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:10.271849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:10.274050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 135/272] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:10.274988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:10.284233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:10.285165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 138/273] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:10.285971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.288969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.398626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9269c-69cb-4f2b-acbe-899d6fe2ab2f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.399924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913a613-cd23-44ce-8a6e-f555ded173a0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.412858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.436375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.437034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.437318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.437417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5eb41-ac02-4e6f-a877-c2adddbe6f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.437619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.438134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5eb41-ac02-4e6f-a877-c2adddbe6f44 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.438418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5eb41-ac02-4e6f-a877-c2adddbe6f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.438511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=cbf7812b65c042e287aecd8bb9800e5d) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:10.438696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5eb41-ac02-4e6f-a877-c2adddbe6f44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.438802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:10.440309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:10.455615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 139/274] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/role_assignments?user.id=cbf7812b65c042e287aecd8bb9800e5d&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:10.455615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.462163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5eb41-ac02-4e6f-a877-c2adddbe6f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c6f5eb41-ac02-4e6f-a877-c2adddbe6f44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:10.471052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:10.472075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:10.472904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 136/275] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:10.475202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09199e4-3cd4-4143-a61c-6655ed159ced None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.475306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09199e4-3cd4-4143-a61c-6655ed159ced None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.477559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09199e4-3cd4-4143-a61c-6655ed159ced None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.477559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 137/276] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:10.478752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09199e4-3cd4-4143-a61c-6655ed159ced None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.585474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.603245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a27062-10b3-4638-90a4-bdae439b2525 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.635143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09199e4-3cd4-4143-a61c-6655ed159ced None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.644587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b77f8-a188-4c84-82f2-20fea2965172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.645264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b77f8-a188-4c84-82f2-20fea2965172 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.645550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b77f8-a188-4c84-82f2-20fea2965172 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.645831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b77f8-a188-4c84-82f2-20fea2965172 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.646625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b77f8-a188-4c84-82f2-20fea2965172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:10.646939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b77f8-a188-4c84-82f2-20fea2965172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:10.648403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b77f8-a188-4c84-82f2-20fea2965172 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:10.657465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 140/277] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:10.658551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8244-196c-4786-a45c-f5bb6b329c1e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.658839 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8244-196c-4786-a45c-f5bb6b329c1e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.659115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8244-196c-4786-a45c-f5bb6b329c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.681869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.682421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-670a8244-196c-4786-a45c-f5bb6b329c1e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:10.682649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.682850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.683139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.684403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:10.684403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:10.684566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-670a8244-196c-4786-a45c-f5bb6b329c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:10.685620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:10.697510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 138/278] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:10.698371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.737153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.787601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 141/279] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:10.787601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8244-196c-4786-a45c-f5bb6b329c1e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.826729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f869c6-5fd0-412c-be4d-3c335c02ceb6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.857209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.864601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.865539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.865822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.866101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] PATH_INFO: `/v3/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.867319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] RBAC: Authorizing `identity:get_user(user_id=76f2dea88ddb4cf1b13b8ca7ff6a8c85)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:10.868792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:10.870673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 139/280] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:10.871200 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.898882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8244-196c-4786-a45c-f5bb6b329c1e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:10.935632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:10.936507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:10.936795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:10.937068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] PATH_INFO: `/v3/users/f55166dec2874ed2a6c2f4fd0d07632f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:10.951549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] RBAC: Authorizing `identity:get_user(user_id=f55166dec2874ed2a6c2f4fd0d07632f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:10.953038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:10.954725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 142/281] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/users/f55166dec2874ed2a6c2f4fd0d07632f => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:10.956384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:10.986469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:10.988634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d40f8-eaad-4b43-9496-08e2ba3f960d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:11.026355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:11.027251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.027528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.027841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.029013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:11.030486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:11.036597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 140/282] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:11.036597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:11.066391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a6a13-8193-492b-b2cc-392d6b9b7f4d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:11.110005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:11.110217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:11.111029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.111423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.111737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.112973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:11.114446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:11.120926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 143/283] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:10 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:11.120926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:11.156697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90128-0f0d-40fd-af99-02a6587e0429 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:11.193302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:11.194014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.194302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.194580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.195427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, user.id=f55166dec2874ed2a6c2f4fd0d07632f, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:11.195797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:11.197238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:11.202888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 141/284] 10.222.0.78 () {56 vars in 1308 bytes} [Mon Jul 4 09:56:11 2022] GET /identity/v3/role_assignments?user.id=f55166dec2874ed2a6c2f4fd0d07632f&scope.system=all&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:11.203501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:11.233098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:11.244860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595d9a-52dc-4938-ae21-131cb9ba00fb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:11.288939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21763992-d4b8-480c-a25c-d5c149cb4718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:11.289654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21763992-d4b8-480c-a25c-d5c149cb4718 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.289931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21763992-d4b8-480c-a25c-d5c149cb4718 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.290197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21763992-d4b8-480c-a25c-d5c149cb4718 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.290944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21763992-d4b8-480c-a25c-d5c149cb4718 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:11.292584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21763992-d4b8-480c-a25c-d5c149cb4718 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:11.321082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 144/285] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:11 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:11.342374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2b26-ea35-46c5-8330-da0011e65108 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:11.384053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031ede6-971b-4264-b668-2b2c631dec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:11.385374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031ede6-971b-4264-b668-2b2c631dec64 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.385863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031ede6-971b-4264-b668-2b2c631dec64 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.389869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:11.390435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031ede6-971b-4264-b668-2b2c631dec64 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85/roles/e7fde74e8a8d4b729df16195b4c76439` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.393132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031ede6-971b-4264-b668-2b2c631dec64 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c752f18e50e43f0a2ee057c963e0fa2, user_id=76f2dea88ddb4cf1b13b8ca7ff6a8c85, role_id=e7fde74e8a8d4b729df16195b4c76439)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:11.394831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031ede6-971b-4264-b668-2b2c631dec64 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:11.414952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 142/286] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:11 2022] PUT /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85/roles/e7fde74e8a8d4b729df16195b4c76439 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:11.518801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5ff2-a772-46a6-a003-43e0119f2d4b None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.519426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5ff2-a772-46a6-a003-43e0119f2d4b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.519937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5ff2-a772-46a6-a003-43e0119f2d4b None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.522269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 145/287] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:11.528710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458cce-6a4c-4555-8b35-53a82b07c543 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.529289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458cce-6a4c-4555-8b35-53a82b07c543 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.529569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458cce-6a4c-4555-8b35-53a82b07c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.551010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6b458cce-6a4c-4555-8b35-53a82b07c543 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:11.552541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6b458cce-6a4c-4555-8b35-53a82b07c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:11.633183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 143/288] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:11.658044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5ff2-a772-46a6-a003-43e0119f2d4b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:11.780107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5ff2-a772-46a6-a003-43e0119f2d4b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:11.818822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:11.819652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:11.819942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:11.820271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:11.831132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:11.839721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:11.840635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:11.841457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:11.843745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 146/289] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:11.847324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458cce-6a4c-4555-8b35-53a82b07c543 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:12.001026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458cce-6a4c-4555-8b35-53a82b07c543 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:12.032994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:12.055990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:12.056683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:12.056966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:12.057238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:12.058008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:12.058315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:12.059714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:12.071924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 144/290] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:12.077195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:12.091201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:12.211675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8f06-8837-4914-8833-2767b6c5d1b3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:12.255262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:12.256669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:12.256918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:12.257194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] PATH_INFO: `/v3/users/fe1a0fb0b11e44d8b28517cb5b210ca2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:12.258430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] RBAC: Authorizing `identity:get_user(user_id=fe1a0fb0b11e44d8b28517cb5b210ca2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:12.259921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:12.265793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 147/291] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:12 2022] GET /identity/v3/users/fe1a0fb0b11e44d8b28517cb5b210ca2 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:12.267069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:12.434572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbc4c7-440c-4336-bee9-3cbcd2b62d51 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:12.482728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:12.483894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:12.484672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:12.485303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:12.548862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:12.579241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:12.580779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:12.698042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 145/292] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:12.703376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:12.834936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:12.859124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44118b4-26cc-4173-b305-8dcea03b2e9f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:12.893404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e205-caa4-4c4b-9f78-cad8e8dd17e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:12.894612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e205-caa4-4c4b-9f78-cad8e8dd17e4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:12.895133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e205-caa4-4c4b-9f78-cad8e8dd17e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:12.895631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e205-caa4-4c4b-9f78-cad8e8dd17e4 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:12.897067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e205-caa4-4c4b-9f78-cad8e8dd17e4 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:12.898718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e205-caa4-4c4b-9f78-cad8e8dd17e4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:12.900961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 148/293] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:12 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:12.906850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:13.000172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:13.019723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1b483-4c2d-4223-9673-c03da6f6b34a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:13.068914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff807d-7b82-4142-827a-194bf22547df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:13.069952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff807d-7b82-4142-827a-194bf22547df None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:13.070435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff807d-7b82-4142-827a-194bf22547df None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:13.070912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff807d-7b82-4142-827a-194bf22547df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:13.071976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff807d-7b82-4142-827a-194bf22547df None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=fe1a0fb0b11e44d8b28517cb5b210ca2) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:13.072511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff807d-7b82-4142-827a-194bf22547df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:13.074142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff807d-7b82-4142-827a-194bf22547df None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:13.084711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 146/294] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:12 2022] GET /identity/v3/role_assignments?user.id=fe1a0fb0b11e44d8b28517cb5b210ca2&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:13.519337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705cdcd-438e-4f6b-8695-3c1bb0c3e764 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:13.520401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705cdcd-438e-4f6b-8695-3c1bb0c3e764 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:13.520920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705cdcd-438e-4f6b-8695-3c1bb0c3e764 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:13.523281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 149/295] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:13.529045 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d436e69-7e23-4a06-84d6-f9d7468f3b2e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:13.529575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d436e69-7e23-4a06-84d6-f9d7468f3b2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:13.530051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d436e69-7e23-4a06-84d6-f9d7468f3b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:13.547968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4d436e69-7e23-4a06-84d6-f9d7468f3b2e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:13.549449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4d436e69-7e23-4a06-84d6-f9d7468f3b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:13.647926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 147/296] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:13.667201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705cdcd-438e-4f6b-8695-3c1bb0c3e764 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:13.782859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705cdcd-438e-4f6b-8695-3c1bb0c3e764 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:13.823132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd5e5-8209-40b5-b811-856411155d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:13.824369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd5e5-8209-40b5-b811-856411155d03 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:13.824854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd5e5-8209-40b5-b811-856411155d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:13.825323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd5e5-8209-40b5-b811-856411155d03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:13.837634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd5e5-8209-40b5-b811-856411155d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-405dd5e5-8209-40b5-b811-856411155d03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:13.845714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:13.846590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:13.847393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:13.850638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 150/297] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:13.856687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d436e69-7e23-4a06-84d6-f9d7468f3b2e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:13.914514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193447-c772-448d-bee2-8191ff1454ac None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:13.915178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193447-c772-448d-bee2-8191ff1454ac None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:13.915713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193447-c772-448d-bee2-8191ff1454ac None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:13.917528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 151/298] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:13.922636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9ea98-0e46-477e-aebd-7ec3888496e9 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:13.923153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9ea98-0e46-477e-aebd-7ec3888496e9 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:13.923678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9ea98-0e46-477e-aebd-7ec3888496e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:13.936771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:13.944655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-88b9ea98-0e46-477e-aebd-7ec3888496e9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:13.946153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-88b9ea98-0e46-477e-aebd-7ec3888496e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:13.947694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:13.997263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d436e69-7e23-4a06-84d6-f9d7468f3b2e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.037691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 152/299] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:14.056641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.057901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.058361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.058782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.059740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:14.060274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:14.061422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9ea98-0e46-477e-aebd-7ec3888496e9 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.061918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:14.072484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 148/300] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:14.078140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.168353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9ea98-0e46-477e-aebd-7ec3888496e9 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.191688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8747ecd-fbe9-42de-906c-eb9250041ecd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.204832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf011-cdb4-4998-860c-dc3513805d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.205643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf011-cdb4-4998-860c-dc3513805d69 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.205925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf011-cdb4-4998-860c-dc3513805d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.206204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf011-cdb4-4998-860c-dc3513805d69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.209709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:14.218454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cf011-cdb4-4998-860c-dc3513805d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-385cf011-cdb4-4998-860c-dc3513805d69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:14.227960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:14.229067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:14.230004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 153/301] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:14.230814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc3a5-6f9e-45c3-9b08-530c44fecbda None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.231054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc3a5-6f9e-45c3-9b08-530c44fecbda None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.231538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc3a5-6f9e-45c3-9b08-530c44fecbda None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.236651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 154/302] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:14.236651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc3a5-6f9e-45c3-9b08-530c44fecbda None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.237307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d317c1f-228c-4a7c-a480-abe5747aae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.238051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d317c1f-228c-4a7c-a480-abe5747aae01 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.238338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d317c1f-228c-4a7c-a480-abe5747aae01 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.238605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d317c1f-228c-4a7c-a480-abe5747aae01 None admin] PATH_INFO: `/v3/users/f55166dec2874ed2a6c2f4fd0d07632f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.240415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d317c1f-228c-4a7c-a480-abe5747aae01 None admin] RBAC: Authorizing `identity:get_user(user_id=f55166dec2874ed2a6c2f4fd0d07632f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:14.242016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d317c1f-228c-4a7c-a480-abe5747aae01 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:14.243953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 149/303] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/users/f55166dec2874ed2a6c2f4fd0d07632f => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:14.246556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8587-b512-47fc-9a94-c54fd213a80f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.246843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8587-b512-47fc-9a94-c54fd213a80f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.247120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8587-b512-47fc-9a94-c54fd213a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.263343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:14.270002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-be7d8587-b512-47fc-9a94-c54fd213a80f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:14.272323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-be7d8587-b512-47fc-9a94-c54fd213a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:14.344477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 150/304] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:14.345691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8587-b512-47fc-9a94-c54fd213a80f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.357135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc3a5-6f9e-45c3-9b08-530c44fecbda None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.393588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.394500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.394781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.395056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.395825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:14.396789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:14.398154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:14.406725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 155/305] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:14.407509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.454928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8587-b512-47fc-9a94-c54fd213a80f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.466579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:14.491389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a55586-6dd3-4938-83eb-b5fad36b4915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.492287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55586-6dd3-4938-83eb-b5fad36b4915 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.492567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55586-6dd3-4938-83eb-b5fad36b4915 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.492858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55586-6dd3-4938-83eb-b5fad36b4915 None admin] PATH_INFO: `/v3/system/users/f55166dec2874ed2a6c2f4fd0d07632f/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.494319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a55586-6dd3-4938-83eb-b5fad36b4915 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f55166dec2874ed2a6c2f4fd0d07632f, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:14.496010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a55586-6dd3-4938-83eb-b5fad36b4915 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:14.499821 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:14.506319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 151/306] 10.222.0.78 () {58 vars in 1334 bytes} [Mon Jul 4 09:56:14 2022] PUT /identity/v3/system/users/f55166dec2874ed2a6c2f4fd0d07632f/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:14.508041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49a2e-5447-4cd6-8ef2-0abefbf5bb91 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.508995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49a2e-5447-4cd6-8ef2-0abefbf5bb91 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.509513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49a2e-5447-4cd6-8ef2-0abefbf5bb91 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.511796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0bfac-6c9e-4dc5-bba3-8f1fbc8d1483 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.516034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 152/307] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:14.520131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae49a2e-5447-4cd6-8ef2-0abefbf5bb91 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.560140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6d6a-9bd7-4b3f-b421-daf1cc0a2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.561040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6d6a-9bd7-4b3f-b421-daf1cc0a2c27 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.561324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6d6a-9bd7-4b3f-b421-daf1cc0a2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.561593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6d6a-9bd7-4b3f-b421-daf1cc0a2c27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.577988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e6d6a-9bd7-4b3f-b421-daf1cc0a2c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-a12e6d6a-9bd7-4b3f-b421-daf1cc0a2c27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:14.586339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:14.587313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:14.588295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 156/308] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:14.590056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78382b3-a482-483b-b649-5ccd032e50b3 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.590056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78382b3-a482-483b-b649-5ccd032e50b3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.590056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78382b3-a482-483b-b649-5ccd032e50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.608181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e78382b3-a482-483b-b649-5ccd032e50b3 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:14.609351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e78382b3-a482-483b-b649-5ccd032e50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:14.651834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae49a2e-5447-4cd6-8ef2-0abefbf5bb91 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.688878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 157/309] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:14.689918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78382b3-a482-483b-b649-5ccd032e50b3 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.700054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.701297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.701808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.702310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] PATH_INFO: `/v3/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.703801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] RBAC: Authorizing `identity:get_user(user_id=76f2dea88ddb4cf1b13b8ca7ff6a8c85)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:14.705444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:14.707337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 153/310] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/users/76f2dea88ddb4cf1b13b8ca7ff6a8c85 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:14.715903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.746717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:14.789399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:14.804406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78382b3-a482-483b-b649-5ccd032e50b3 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.826234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9b665-ba25-4632-8f0e-f5afb3698c58 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.841709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.842385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.842668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.842945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.843908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:14.844323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:14.845743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:14.855263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 158/311] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:14.855946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:14.867099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:14.867737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:14.868028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:14.868310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:14.938320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:14.939829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:14.970450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d31cde-94dc-43f6-b663-ac5ed88bad35 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:14.981059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:15.007392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:15.008221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:15.008504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:15.008779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:15.009302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:15.010228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:15.011698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:15.013666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 159/312] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:15.014453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:15.051532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 154/313] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:15.052837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:15.127522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa6f9-4cb5-4682-95dd-a8be02b7e96b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:15.166071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b223e-2b53-4e2d-953a-d78a870772ee None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:15.170057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:15.171193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:15.171729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:15.172237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] PATH_INFO: `/v3/users/36ab9acb8bc34c59ad1d393de840ae2a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:15.190172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] RBAC: Authorizing `identity:get_user(user_id=36ab9acb8bc34c59ad1d393de840ae2a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:15.192414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:15.195745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 160/314] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:15 2022] GET /identity/v3/users/36ab9acb8bc34c59ad1d393de840ae2a => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:15.197297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:15.203767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:15.204446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:15.204732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:15.205009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] PATH_INFO: `/v3/groups` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:15.205709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:15.207149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:15.223046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 155/315] 10.222.0.78 () {60 vars in 1134 bytes} [Mon Jul 4 09:56:15 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:15.224256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:15.254301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:15.271884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:15.360261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefdf0b-8088-4a6c-b72d-400fb008ab81 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:15.394052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a9d4d-7efc-41e9-a70d-fe082e19dc11 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:15.403707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:15.404518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:15.404795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:15.405068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:15.406274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:15.407764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:15.409666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 161/316] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:15 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:15.420559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:15.444815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf86df-2331-4393-ab3a-1bcdd1ad465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:15.445485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf86df-2331-4393-ab3a-1bcdd1ad465a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:15.445773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf86df-2331-4393-ab3a-1bcdd1ad465a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:15.446052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf86df-2331-4393-ab3a-1bcdd1ad465a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:15.447051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf86df-2331-4393-ab3a-1bcdd1ad465a None admin] RBAC: Adding query filter params (role.id=e7fde74e8a8d4b729df16195b4c76439, user.id=36ab9acb8bc34c59ad1d393de840ae2a, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:15.447372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf86df-2331-4393-ab3a-1bcdd1ad465a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:15.448878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf86df-2331-4393-ab3a-1bcdd1ad465a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:15.454028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 156/317] 10.222.0.78 () {56 vars in 1308 bytes} [Mon Jul 4 09:56:15 2022] GET /identity/v3/role_assignments?user.id=36ab9acb8bc34c59ad1d393de840ae2a&scope.system=all&role.id=e7fde74e8a8d4b729df16195b4c76439 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:15.549748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf4b17-489c-49f0-99f8-c4bd811f31f7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:15.552447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:15.592565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5691db-9470-4aa3-90b1-2d955f94e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:15.593247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5691db-9470-4aa3-90b1-2d955f94e4ec None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:15.593504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5691db-9470-4aa3-90b1-2d955f94e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:15.593783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5691db-9470-4aa3-90b1-2d955f94e4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:15.594628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5691db-9470-4aa3-90b1-2d955f94e4ec None admin] RBAC: Adding query filter params (role.id=e7fde74e8a8d4b729df16195b4c76439, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2, user.id=76f2dea88ddb4cf1b13b8ca7ff6a8c85) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:15.594937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5691db-9470-4aa3-90b1-2d955f94e4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:15.596434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5691db-9470-4aa3-90b1-2d955f94e4ec None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:15.604362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 162/318] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:15 2022] GET /identity/v3/role_assignments?user.id=76f2dea88ddb4cf1b13b8ca7ff6a8c85&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=e7fde74e8a8d4b729df16195b4c76439 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:16.600100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136319-575c-4cdd-9f75-a349ff124ae3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:16.600608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136319-575c-4cdd-9f75-a349ff124ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:16.600692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136319-575c-4cdd-9f75-a349ff124ae3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:16.602067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 157/319] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:16.607104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af81180-a0e0-4b36-8323-78901e390a59 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:16.607501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af81180-a0e0-4b36-8323-78901e390a59 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:16.607688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af81180-a0e0-4b36-8323-78901e390a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:16.627993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0af81180-a0e0-4b36-8323-78901e390a59 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:16.629178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0af81180-a0e0-4b36-8323-78901e390a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:16.697039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 163/320] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:16.720043 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136319-575c-4cdd-9f75-a349ff124ae3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:16.813687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:16.825753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136319-575c-4cdd-9f75-a349ff124ae3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:16.860894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:16.861622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:16.861907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:16.862183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:16.873071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:16.881386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:16.882340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:16.883134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:16.884473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 158/321] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:16.888374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af81180-a0e0-4b36-8323-78901e390a59 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:16.989347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:16.994032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af81180-a0e0-4b36-8323-78901e390a59 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:17.029519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:17.030249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.030535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.030808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.031655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:17.031967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:17.033434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:17.045994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 164/322] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:17.047238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:17.151073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a72fe-449d-4892-b7b2-0c87aaff8b9d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:17.185433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d3cb3-eb31-473c-908c-bb6ce2072dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:17.186321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d3cb3-eb31-473c-908c-bb6ce2072dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.186608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d3cb3-eb31-473c-908c-bb6ce2072dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.186887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d3cb3-eb31-473c-908c-bb6ce2072dc8 None admin] PATH_INFO: `/v3/users/f55166dec2874ed2a6c2f4fd0d07632f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.188119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d3cb3-eb31-473c-908c-bb6ce2072dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=f55166dec2874ed2a6c2f4fd0d07632f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:17.189574 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d3cb3-eb31-473c-908c-bb6ce2072dc8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:17.191384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 159/323] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:17 2022] GET /identity/v3/users/f55166dec2874ed2a6c2f4fd0d07632f => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:17.197612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:17.302049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75d929-882b-4702-920b-01a4c0e518f7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:17.336782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0486b-3131-48f1-a1ca-99744d3b4cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:17.337451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0486b-3131-48f1-a1ca-99744d3b4cfb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.337737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0486b-3131-48f1-a1ca-99744d3b4cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.338014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0486b-3131-48f1-a1ca-99744d3b4cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.338858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0486b-3131-48f1-a1ca-99744d3b4cfb None admin] RBAC: Adding query filter params (role.id=b70d42d686f74daf87804f3a36b591a5, user.id=f55166dec2874ed2a6c2f4fd0d07632f, scope.system=all) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:17.339175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0486b-3131-48f1-a1ca-99744d3b4cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:17.340660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0486b-3131-48f1-a1ca-99744d3b4cfb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:17.354096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 165/324] 10.222.0.78 () {56 vars in 1308 bytes} [Mon Jul 4 09:56:17 2022] GET /identity/v3/role_assignments?user.id=f55166dec2874ed2a6c2f4fd0d07632f&scope.system=all&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:17.393442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7a5c-8de3-4007-9d48-8d8596656b66 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.393753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7a5c-8de3-4007-9d48-8d8596656b66 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.393999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7a5c-8de3-4007-9d48-8d8596656b66 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.395552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 160/325] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:17.401845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e563-2820-4914-bf96-59a35c8ce0c4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.402042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e563-2820-4914-bf96-59a35c8ce0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.402320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e563-2820-4914-bf96-59a35c8ce0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.420199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-4a49e563-2820-4914-bf96-59a35c8ce0c4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:17.421437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-4a49e563-2820-4914-bf96-59a35c8ce0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:17.436807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:17.496387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 166/326] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:17.517230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c896f-a6e6-4dc2-ba22-e79fd11899b3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.517720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c896f-a6e6-4dc2-ba22-e79fd11899b3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.518012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c896f-a6e6-4dc2-ba22-e79fd11899b3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.518633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e563-2820-4914-bf96-59a35c8ce0c4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:17.519549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 161/327] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:17.525994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510e3b-b0a3-448e-bee0-abae0f0ed6d9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.526293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510e3b-b0a3-448e-bee0-abae0f0ed6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.526583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510e3b-b0a3-448e-bee0-abae0f0ed6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.547827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7e510e3b-b0a3-448e-bee0-abae0f0ed6d9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:17.549044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7e510e3b-b0a3-448e-bee0-abae0f0ed6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:17.567397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:17.621367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 162/328] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:17.635689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e563-2820-4914-bf96-59a35c8ce0c4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:17.644206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510e3b-b0a3-448e-bee0-abae0f0ed6d9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:17.669388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:17.670113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.670399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.670678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.671882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:17.673333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:17.674954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 167/329] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:17.680553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:17.698049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:17.743233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510e3b-b0a3-448e-bee0-abae0f0ed6d9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:17.778226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:17.778390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84522c-a981-4d0f-bc28-e0eb5dea49d4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:17.779027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.779312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.779613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.790265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:17.798036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:17.798957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:17.799822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:17.804010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 163/330] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:17.805670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:17.811840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:17.812503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.812782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.813052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] PATH_INFO: `/v3/groups` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.813734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:17.815172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:17.818386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:17.830445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 168/331] 10.222.0.78 () {60 vars in 1134 bytes} [Mon Jul 4 09:56:17 2022] POST /identity/v3/groups => generated 226 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:56:17.914490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9796e1-8019-46a4-97b0-55395affac0f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:17.952322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:17.952995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:17.953282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:17.953561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:17.954324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:17.954636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:17.956082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:17.970280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 164/332] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:17.977026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:18.057042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:18.084130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27761b-391f-4f5b-8d96-56871752e4a1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:18.121120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e0c84-0171-4a28-86ed-3b416ecba5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:18.122012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0c84-0171-4a28-86ed-3b416ecba5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:18.122288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0c84-0171-4a28-86ed-3b416ecba5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:18.122556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0c84-0171-4a28-86ed-3b416ecba5c4 None admin] PATH_INFO: `/v3/users/36ab9acb8bc34c59ad1d393de840ae2a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:18.123786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e0c84-0171-4a28-86ed-3b416ecba5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=36ab9acb8bc34c59ad1d393de840ae2a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:18.125240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e0c84-0171-4a28-86ed-3b416ecba5c4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:18.127227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 169/333] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:17 2022] GET /identity/v3/users/36ab9acb8bc34c59ad1d393de840ae2a => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:18.132916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:18.214356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:18.248377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bedba-393d-491c-9b2a-a37c3287a7e1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:18.288909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738ba12-12b3-4dbf-899d-e3a45bd5d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:18.289799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738ba12-12b3-4dbf-899d-e3a45bd5d2d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:18.290090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738ba12-12b3-4dbf-899d-e3a45bd5d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:18.290377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738ba12-12b3-4dbf-899d-e3a45bd5d2d1 None admin] PATH_INFO: `/v3/system/users/36ab9acb8bc34c59ad1d393de840ae2a/roles/e7fde74e8a8d4b729df16195b4c76439` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:18.292352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738ba12-12b3-4dbf-899d-e3a45bd5d2d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36ab9acb8bc34c59ad1d393de840ae2a, role_id=e7fde74e8a8d4b729df16195b4c76439)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:18.293711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738ba12-12b3-4dbf-899d-e3a45bd5d2d1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:18.302901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 165/334] 10.222.0.78 () {58 vars in 1334 bytes} [Mon Jul 4 09:56:18 2022] PUT /identity/v3/system/users/36ab9acb8bc34c59ad1d393de840ae2a/roles/e7fde74e8a8d4b729df16195b4c76439 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:56:20.541915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303abbc9-e4dd-454f-b2c0-20b492804102 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:20.542930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303abbc9-e4dd-454f-b2c0-20b492804102 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:20.543419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303abbc9-e4dd-454f-b2c0-20b492804102 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:20.545327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 170/335] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:20.550461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c8d3-8d3a-4726-a7a3-6a451553321f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:20.551285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c8d3-8d3a-4726-a7a3-6a451553321f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:20.551823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c8d3-8d3a-4726-a7a3-6a451553321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:20.570807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a556c7-04de-4ba9-b510-1fe5acb91ecc None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:20.571158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a556c7-04de-4ba9-b510-1fe5acb91ecc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:20.571370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a556c7-04de-4ba9-b510-1fe5acb91ecc None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:20.574550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 171/336] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:20.578073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d318-87bb-40c6-b933-01aa1ec3b7bb None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:20.578357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d318-87bb-40c6-b933-01aa1ec3b7bb None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:20.578646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d318-87bb-40c6-b933-01aa1ec3b7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:20.595976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1156c8d3-8d3a-4726-a7a3-6a451553321f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:20.597516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1156c8d3-8d3a-4726-a7a3-6a451553321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:20.608606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ae83d318-87bb-40c6-b933-01aa1ec3b7bb None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:20.610168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ae83d318-87bb-40c6-b933-01aa1ec3b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:20.698182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 166/337] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:20.745511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156c8d3-8d3a-4726-a7a3-6a451553321f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:20.766198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 172/338] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:20.792400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d318-87bb-40c6-b933-01aa1ec3b7bb None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:20.863938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:20.879032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156c8d3-8d3a-4726-a7a3-6a451553321f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:20.933022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538867ba-3d77-4944-afe3-8ea32cc0f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:20.933852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538867ba-3d77-4944-afe3-8ea32cc0f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:20.934139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538867ba-3d77-4944-afe3-8ea32cc0f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:20.934421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538867ba-3d77-4944-afe3-8ea32cc0f0d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:20.949029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538867ba-3d77-4944-afe3-8ea32cc0f0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-538867ba-3d77-4944-afe3-8ea32cc0f0d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:20.961696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:20.962610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:20.963414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:20.964060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 167/339] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:20.966640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c82dd-0a91-4c8b-bb56-41367756aca5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:20.966640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c82dd-0a91-4c8b-bb56-41367756aca5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:20.966640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c82dd-0a91-4c8b-bb56-41367756aca5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:20.966640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 168/340] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:20.971529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c82dd-0a91-4c8b-bb56-41367756aca5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:20.972339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:21.046678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d318-87bb-40c6-b933-01aa1ec3b7bb None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:21.101225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c82dd-0a91-4c8b-bb56-41367756aca5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:21.113235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a571824-2acd-4cb9-aba9-2da00ee94f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:21.114064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a571824-2acd-4cb9-aba9-2da00ee94f05 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.115040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a571824-2acd-4cb9-aba9-2da00ee94f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.115510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a571824-2acd-4cb9-aba9-2da00ee94f05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.133116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a571824-2acd-4cb9-aba9-2da00ee94f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:21.134504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9a571824-2acd-4cb9-aba9-2da00ee94f05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:21.145129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:21.146092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:21.146898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 173/341] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:21.147963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d837a0-807c-4667-a628-b440d41c9448 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.148478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d837a0-807c-4667-a628-b440d41c9448 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.148933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d837a0-807c-4667-a628-b440d41c9448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.154452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:21.155376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.155837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.156246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.157147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:21.157583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:21.159111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:21.178965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 169/342] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:21.180144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:21.182230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f7d837a0-807c-4667-a628-b440d41c9448 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:21.183923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f7d837a0-807c-4667-a628-b440d41c9448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:21.286045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 174/343] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:21.292083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe804b16-ed3e-463c-bead-a846fa7e6cce None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.292226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe804b16-ed3e-463c-bead-a846fa7e6cce None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.292481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe804b16-ed3e-463c-bead-a846fa7e6cce None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.293872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 175/344] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:21.294611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe804b16-ed3e-463c-bead-a846fa7e6cce None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:21.332693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f1bb1-a589-405d-a590-19d3a1aa3730 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:21.386038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4d79-6809-4c8c-b555-6bd7813f0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:21.387538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4d79-6809-4c8c-b555-6bd7813f0893 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.388057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4d79-6809-4c8c-b555-6bd7813f0893 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.388967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4d79-6809-4c8c-b555-6bd7813f0893 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.390249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4d79-6809-4c8c-b555-6bd7813f0893 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:21.391017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4d79-6809-4c8c-b555-6bd7813f0893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:21.393376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4d79-6809-4c8c-b555-6bd7813f0893 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:21.395141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:21.408131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 170/345] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:21.409786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da499f3-1b58-443d-8b8e-f21e7503b95d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.410305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da499f3-1b58-443d-8b8e-f21e7503b95d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.410780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da499f3-1b58-443d-8b8e-f21e7503b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.453957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5da499f3-1b58-443d-8b8e-f21e7503b95d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:21.455387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5da499f3-1b58-443d-8b8e-f21e7503b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:21.457571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe804b16-ed3e-463c-bead-a846fa7e6cce None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:21.505488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:21.506567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.507050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.507523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.515802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:21.541274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 171/346] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:21.542180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da499f3-1b58-443d-8b8e-f21e7503b95d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:21.608655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:21.610694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:21.695076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da499f3-1b58-443d-8b8e-f21e7503b95d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:21.707968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:21.731320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 176/347] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:21.736520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:21.743266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:21.744111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.744401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.744676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.759141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:21.769491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:21.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:21.771850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:21.774651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 172/348] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:21.779823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:21.832523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:21.868491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85690f7-aa0c-4aa8-bcff-2b78b4b2029a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:21.915861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535938-3fdf-4a91-9783-e32bf61298f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:21.916322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:21.917003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.917288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.917565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.954831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:21.955713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:21.956167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:21.956380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:21.956609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:21.969961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:21.979434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:21.980509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 09:56:21.981954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:21.985937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 173/349] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:21.986873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.002898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.004409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.124933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:22.130811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f3f2d-8adb-4ea8-8a54-ff41473e23a9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.143072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 177/350] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:22.144889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.177462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402054-4c3f-4edd-8edf-ad2da7317229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.178605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402054-4c3f-4edd-8edf-ad2da7317229 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.179047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402054-4c3f-4edd-8edf-ad2da7317229 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.179470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402054-4c3f-4edd-8edf-ad2da7317229 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.180757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402054-4c3f-4edd-8edf-ad2da7317229 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.182211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402054-4c3f-4edd-8edf-ad2da7317229 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.183999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 174/351] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:21 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:22.185433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578e4f-4b7f-49be-8fa6-b51fa2a954bc None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.185722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578e4f-4b7f-49be-8fa6-b51fa2a954bc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.186000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578e4f-4b7f-49be-8fa6-b51fa2a954bc None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.187374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 175/352] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:22.189981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578e4f-4b7f-49be-8fa6-b51fa2a954bc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.245087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:22.284756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b668d23-d783-4038-b31e-1882824ec50e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.318591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578e4f-4b7f-49be-8fa6-b51fa2a954bc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.331370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.332384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.332883 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.333472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.334455 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:22.334824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.336419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.345888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 178/353] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:22.346713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.366623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.367703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.367987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.368256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.369179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:22.369482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.371007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.382019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 176/354] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:22.382797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.421686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:22.469645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db600-cc04-4c4c-9b85-69f5ce65593a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.498538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:22.506527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef76c7-f9da-407d-8535-d3627d6b1f48 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.512245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c96174-8b80-4785-8740-46c2d5954988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.513130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c96174-8b80-4785-8740-46c2d5954988 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.513417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c96174-8b80-4785-8740-46c2d5954988 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.513694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c96174-8b80-4785-8740-46c2d5954988 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.514981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c96174-8b80-4785-8740-46c2d5954988 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.516563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c96174-8b80-4785-8740-46c2d5954988 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.518301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 179/355] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:22.524355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3020a8-43ef-49a3-829c-364bdfc4f8ff None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.524355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3020a8-43ef-49a3-829c-364bdfc4f8ff None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.524355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3020a8-43ef-49a3-829c-364bdfc4f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.539224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ab3020a8-43ef-49a3-829c-364bdfc4f8ff None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:22.540465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ab3020a8-43ef-49a3-829c-364bdfc4f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:22.546428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4f11-ec08-417e-9fd3-38a5faf50520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.547292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4f11-ec08-417e-9fd3-38a5faf50520 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.547602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4f11-ec08-417e-9fd3-38a5faf50520 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.547879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4f11-ec08-417e-9fd3-38a5faf50520 None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.557293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4f11-ec08-417e-9fd3-38a5faf50520 None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.558757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4f11-ec08-417e-9fd3-38a5faf50520 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.563706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 177/356] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:22.565600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209e43-2e24-48e5-94eb-115269fdd2be None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.566146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209e43-2e24-48e5-94eb-115269fdd2be None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.566431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209e43-2e24-48e5-94eb-115269fdd2be None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.568585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 178/357] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:22.573229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209e43-2e24-48e5-94eb-115269fdd2be None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.622997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 180/358] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:22.623495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3020a8-43ef-49a3-829c-364bdfc4f8ff None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.692952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:22.701436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209e43-2e24-48e5-94eb-115269fdd2be None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.741282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.741939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.742228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.742508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.748357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3020a8-43ef-49a3-829c-364bdfc4f8ff None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.777391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:22.794188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.795630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.796072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.796354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] PATH_INFO: `/v3/users/36ab9acb8bc34c59ad1d393de840ae2a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.797603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] RBAC: Authorizing `identity:get_user(user_id=36ab9acb8bc34c59ad1d393de840ae2a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.799204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.801312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 181/359] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/users/36ab9acb8bc34c59ad1d393de840ae2a => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:22.802601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.823746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.826054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.920369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb54e4-ffb7-4515-84ef-858c2f2e2231 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:22.935675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:22.944658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 179/360] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:22.945727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:22.967660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa29fe-6fdd-473c-ae75-fbd8404b5bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:22.968844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa29fe-6fdd-473c-ae75-fbd8404b5bbe None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.969306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa29fe-6fdd-473c-ae75-fbd8404b5bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.969766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa29fe-6fdd-473c-ae75-fbd8404b5bbe None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:22.972354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa29fe-6fdd-473c-ae75-fbd8404b5bbe None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:22.974398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa29fe-6fdd-473c-ae75-fbd8404b5bbe None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:22.976205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 182/361] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:22.977409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ef7a-4dee-4fbd-ba98-f63c240f75bf None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:22.977697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ef7a-4dee-4fbd-ba98-f63c240f75bf None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:22.977977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ef7a-4dee-4fbd-ba98-f63c240f75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.005797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-8e37ef7a-4dee-4fbd-ba98-f63c240f75bf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:23.006995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8e37ef7a-4dee-4fbd-ba98-f63c240f75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:23.072155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881223f-6c1b-4488-ad72-b061358cf1fe None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.079651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:23.094753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 183/362] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:23.095927 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ef7a-4dee-4fbd-ba98-f63c240f75bf None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.113388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.114055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.114871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.115151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.116078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=175a398948844db0b21c22ce03469d75) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:23.116396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:23.117841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:23.123907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 180/363] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:22 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:23.132870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.228710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:23.243134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ef7a-4dee-4fbd-ba98-f63c240f75bf None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.290250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.290491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf33482-0d5a-4082-b3c8-6cb71101ba25 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.291463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.291915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.292366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.310267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:23.320945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:23.321958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 184/364] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:23.322954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.344254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.344254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.344700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.344879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.345674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] RBAC: Adding query filter params (role.id=e7fde74e8a8d4b729df16195b4c76439, user.id=36ab9acb8bc34c59ad1d393de840ae2a, scope.system=all) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:23.345982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:23.347435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:23.362944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 181/365] 10.222.0.78 () {56 vars in 1308 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/role_assignments?user.id=36ab9acb8bc34c59ad1d393de840ae2a&scope.system=all&role.id=e7fde74e8a8d4b729df16195b4c76439 => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:23.363768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.403733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:23.469236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef72f4c-bd47-4292-99c5-2a58bd86dfd5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.499523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cad19-0483-4bd0-853f-fc720ccb493e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.519410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.521581 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.521994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.522279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.523541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:23.524498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:23.526339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:23.529099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 185/366] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:23.530314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.547873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.548549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.548834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.549116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.549970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=175a398948844db0b21c22ce03469d75) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:23.550348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:23.552089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:23.559217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 182/367] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:23.560167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.672599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944475b2-73bb-40ad-95b6-f0c2e0df7f1c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.695702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:23.697554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6c06c-892d-4795-8bc6-c05b7bdd60ff None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.716683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.717857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.718322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.718778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.732628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:23.745768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:23.746299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:23.747151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:23.747992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:23.749130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 186/368] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:23.749519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.750435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.750928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.751407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.752463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:23.753077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:23.755474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:23.765462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 183/369] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:23.766746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.825839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:23.881966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d989-ad5f-409c-968d-89e98633e2ff None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.909848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856048-fa54-4e4b-95b2-a4037717d3a5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:23.927017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.928760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.929144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.929519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.930830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:23.932537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:23.934620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 187/370] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:23.935340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:23.962830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:23.963826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:23.964255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:23.964679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:23.966273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:23.966735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:23.968889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:23.982263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 184/371] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:23.983824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:24.001658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:24.077180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e8cc-d504-45ae-8b22-24cb2c92b6df None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:24.124816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:24.125797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:24.126887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:24.127494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:24.133990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aa9fa-0514-4ac3-b1d3-0e7756ae8aca None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:24.137601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:24.191255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:24.192085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:24.192919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:24.193194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:24.194508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:24.194508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:24.195823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:24.207815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 185/372] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:24.209281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:24.251432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:24.253026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:24.364459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:24.413431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8847e-814b-44b9-9ab5-683b5f2c1642 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:24.454685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:24.455369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:24.455676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:24.455958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:24.490213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 188/373] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:24.496493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:24.517030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:24.576597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:24.578078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:24.622009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcba8f-6a09-41e7-8f1f-712aaba119d9 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:24.662185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:24.663448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:24.663952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:24.664425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:24.665988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:24.667744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:24.670241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 189/374] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:24 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:24.675967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:24.698857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:24.772800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 186/375] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:24.777665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:24.799612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f288069-8fb3-492f-a5de-4df32e6ffe84 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:24.838356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:24.839753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:24.840257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:24.840741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:24.842314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:24.844304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:24.846680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 190/376] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:24 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:24.855205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:24.879004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:24.939413 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8105da-f4a3-4a6b-bd79-b27b8c144b2c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:24.992034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:25.013172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10cb70-2372-410a-92b9-78ff4fa65bbe None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:25.021434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:25.022439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.022630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.022931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] PATH_INFO: `/v3/projects/b97d6692af504c1fa68b44270187348b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.028326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] RBAC: Authorizing `identity:get_project(project_id=b97d6692af504c1fa68b44270187348b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:25.029780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:25.031812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 187/377] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:24 2022] GET /identity/v3/projects/b97d6692af504c1fa68b44270187348b => generated 344 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:25.036972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:25.057166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:25.058206 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.058699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.059232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.060487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:25.061021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:25.062722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:25.070271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 191/378] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:24 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:25.239011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040826-437b-4a36-808f-755df2bde31c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:25.282548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd652fc-afed-424a-a006-576660cccfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:25.283344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd652fc-afed-424a-a006-576660cccfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.283656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd652fc-afed-424a-a006-576660cccfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.283938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd652fc-afed-424a-a006-576660cccfa1 None admin] PATH_INFO: `/v3/groups/f19daa190bb34718997eb392f3ea61d2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.286790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:25.293975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd652fc-afed-424a-a006-576660cccfa1 None admin] RBAC: Authorizing `identity:get_group(group_id=f19daa190bb34718997eb392f3ea61d2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:25.295420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd652fc-afed-424a-a006-576660cccfa1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:25.297468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 188/379] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:25 2022] GET /identity/v3/groups/f19daa190bb34718997eb392f3ea61d2 => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:25.304285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:25.452680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ab7d-3760-4e1c-b415-4e14e0664cb7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:25.492519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4e557-b9e6-439c-809c-1025e6286460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:25.493594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e557-b9e6-439c-809c-1025e6286460 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.494082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e557-b9e6-439c-809c-1025e6286460 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.494561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e557-b9e6-439c-809c-1025e6286460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.495634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e557-b9e6-439c-809c-1025e6286460 None admin] RBAC: Adding query filter params (group.id=f19daa190bb34718997eb392f3ea61d2, role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=b97d6692af504c1fa68b44270187348b) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:25.496170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e557-b9e6-439c-809c-1025e6286460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:25.497846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e557-b9e6-439c-809c-1025e6286460 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:25.504119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 192/380] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:25 2022] GET /identity/v3/role_assignments?group.id=f19daa190bb34718997eb392f3ea61d2&scope.project.id=b97d6692af504c1fa68b44270187348b&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:25.621190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c003-528f-4e7c-92f8-6c23a7ff306d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.621525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c003-528f-4e7c-92f8-6c23a7ff306d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.621758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c003-528f-4e7c-92f8-6c23a7ff306d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.623449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 189/381] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:25.629179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dd6eb-56b2-44d9-af9d-807374b2fac5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.629475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dd6eb-56b2-44d9-af9d-807374b2fac5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.630342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dd6eb-56b2-44d9-af9d-807374b2fac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.652907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7e9dd6eb-56b2-44d9-af9d-807374b2fac5 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:25.654327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7e9dd6eb-56b2-44d9-af9d-807374b2fac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:25.657829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:25.735828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 193/382] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:25.761823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0c003-528f-4e7c-92f8-6c23a7ff306d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:25.894202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44548d4d-4fd9-431e-b498-c6e356cf7fe1 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.894391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44548d4d-4fd9-431e-b498-c6e356cf7fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.894686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44548d4d-4fd9-431e-b498-c6e356cf7fe1 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.896399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 194/383] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:25.902015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c70f-ffc8-41a2-b17f-4d17998e611d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.902305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c70f-ffc8-41a2-b17f-4d17998e611d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.902588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c70f-ffc8-41a2-b17f-4d17998e611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:25.934297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-07c8c70f-ffc8-41a2-b17f-4d17998e611d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:25.935526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-07c8c70f-ffc8-41a2-b17f-4d17998e611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:25.936315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0c003-528f-4e7c-92f8-6c23a7ff306d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:25.978298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:25.980134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:25.980805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:25.981944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:26.003058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:26.017364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:26.018683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:26.019524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:26.025905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 190/384] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:26.031626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:26.066167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 195/385] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:26.105460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c70f-ffc8-41a2-b17f-4d17998e611d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:26.125036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:26.172944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ab78f-9d0c-456a-b269-b64cb9de10cc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:26.227699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:26.228391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:26.228677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:26.228962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:26.229728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:26.230042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:26.232434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:26.245302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:26.255362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 191/386] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:26.262445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:26.329813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c70f-ffc8-41a2-b17f-4d17998e611d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:26.388252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19727c7-a569-42c9-9a05-e86823bf5e80 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:26.389226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:26.390527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:26.390808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:26.391081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:26.416512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:26.417597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:26.427778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:26.429302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:26.429836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:26.430314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:26.431775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:26.431896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:26.432793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:26.433615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 196/387] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:26.436378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:26.438543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 192/388] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:26 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:26.440480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:26.443961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:26.650524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bbc8c-a38d-494f-9ca9-a8f7ff85bc94 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:26.669735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beba3e-afec-45ac-b359-24c38442a240 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:26.688328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:26.689214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:26.689500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:26.689778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:26.695379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:26.695379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:26.695379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 193/389] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:26 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:26.701289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:26.745297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:26.758843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:26.759627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:26.759916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:26.760193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:26.760959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:26.761269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:26.762909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:26.785918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 197/390] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:26.788131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:26.789737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:26.884541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181ab1d-a2d1-4ab9-a236-f26ebd4def2f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:26.954518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83f082-3997-47b8-9778-7457176f2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:26.955325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f082-3997-47b8-9778-7457176f2230 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:26.955626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f082-3997-47b8-9778-7457176f2230 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:26.955909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83f082-3997-47b8-9778-7457176f2230 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75/groups/1620f332e6d140249d6264825ff4fc2f/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:26.962144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83f082-3997-47b8-9778-7457176f2230 None admin] RBAC: Authorizing `identity:create_grant(project_id=175a398948844db0b21c22ce03469d75, group_id=1620f332e6d140249d6264825ff4fc2f, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:26.963619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83f082-3997-47b8-9778-7457176f2230 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:26.978022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3edf3-e92c-4333-8bd5-1762fbc967db None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:26.987521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 194/391] 10.222.0.78 () {58 vars in 1442 bytes} [Mon Jul 4 09:56:26 2022] PUT /identity/v3/projects/175a398948844db0b21c22ce03469d75/groups/1620f332e6d140249d6264825ff4fc2f/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:27.034831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be07c6-2ee9-4f9e-977e-bdff01da31e8 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.035565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be07c6-2ee9-4f9e-977e-bdff01da31e8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.036157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be07c6-2ee9-4f9e-977e-bdff01da31e8 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.038293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 195/392] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:27.045136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3f99-9651-4b85-ac98-d3b585e16b05 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.045370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:27.046000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3f99-9651-4b85-ac98-d3b585e16b05 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.046115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.046279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.046560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.046941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3f99-9651-4b85-ac98-d3b585e16b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.047874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:27.049470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:27.051150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 198/393] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:26 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:27.057805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:27.069156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1d9e3f99-9651-4b85-ac98-d3b585e16b05 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:27.070819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1d9e3f99-9651-4b85-ac98-d3b585e16b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:27.172447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:27.182445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 196/394] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:27.203973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3f99-9651-4b85-ac98-d3b585e16b05 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:27.218474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776925a0-7b98-460d-abde-aa5cd30b793e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:27.253779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:27.255196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.255473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.255768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.256975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:27.258430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:27.263145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:27.265150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 199/395] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:27 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:27.266216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:27.324994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3f99-9651-4b85-ac98-d3b585e16b05 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:27.362510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:27.363777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.364257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.364778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.373529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125ff3-d3ae-4f07-aad0-ec69d9d324f8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:27.377102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:27.386183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:27.387103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:27.387957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:27.390759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 197/396] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:27.397359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:27.403148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:27.411841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:27.412821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.413172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.413677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75/groups/1620f332e6d140249d6264825ff4fc2f/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.417391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] RBAC: Authorizing `identity:create_grant(project_id=175a398948844db0b21c22ce03469d75, group_id=1620f332e6d140249d6264825ff4fc2f, role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:27.418995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:27.450977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 200/397] 10.222.0.78 () {58 vars in 1442 bytes} [Mon Jul 4 09:56:27 2022] PUT /identity/v3/projects/175a398948844db0b21c22ce03469d75/groups/1620f332e6d140249d6264825ff4fc2f/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:56:27.518361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6fff2-ef73-4cd9-8904-0bd0561ae2e9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:27.536624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:27.567857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf578585-0266-4637-a5b3-1d2c9dcb83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:27.568832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf578585-0266-4637-a5b3-1d2c9dcb83b7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.569270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf578585-0266-4637-a5b3-1d2c9dcb83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.569715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf578585-0266-4637-a5b3-1d2c9dcb83b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.570660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf578585-0266-4637-a5b3-1d2c9dcb83b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:27.571123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf578585-0266-4637-a5b3-1d2c9dcb83b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:27.572888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf578585-0266-4637-a5b3-1d2c9dcb83b7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:27.588925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 198/398] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:27.600830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:27.649705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740fad8-cea4-481c-865c-773227b50cde None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.650408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740fad8-cea4-481c-865c-773227b50cde None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.650914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740fad8-cea4-481c-865c-773227b50cde None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.653069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 199/399] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:27.658786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700bae-cd3f-4f3f-84b0-6096703a89c4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.659370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700bae-cd3f-4f3f-84b0-6096703a89c4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.659887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700bae-cd3f-4f3f-84b0-6096703a89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.681550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9a700bae-cd3f-4f3f-84b0-6096703a89c4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:27.682781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9a700bae-cd3f-4f3f-84b0-6096703a89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:27.766388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d2269-97c8-4428-80bb-6d10c4078160 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:27.779087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 200/400] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:27.803981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:27.804850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.804968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700bae-cd3f-4f3f-84b0-6096703a89c4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:27.805128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.805405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:27.807776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:27.809382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:27.811365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 201/401] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:27 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:27.817022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:27.905035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:27.952781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:27.955619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700bae-cd3f-4f3f-84b0-6096703a89c4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:27.974845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b80b4-4a15-4e54-8d7f-a670efe2a6c5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:27.992008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95ddf-ac20-40ed-b051-700709513497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:27.992828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95ddf-ac20-40ed-b051-700709513497 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:27.993115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95ddf-ac20-40ed-b051-700709513497 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:27.993395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95ddf-ac20-40ed-b051-700709513497 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.004171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95ddf-ac20-40ed-b051-700709513497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:28.014525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a1d95ddf-ac20-40ed-b051-700709513497 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:28.014681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:28.015531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:28.016843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 201/402] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:28.017498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376045-ec6f-4948-9f94-7df503d6dd33 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.017838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376045-ec6f-4948-9f94-7df503d6dd33 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.017932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376045-ec6f-4948-9f94-7df503d6dd33 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.019047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.019149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 202/403] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:28.024771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.025252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.025993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68505f-1632-4f35-845c-f181eebbd6f9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.026522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68505f-1632-4f35-845c-f181eebbd6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.026990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68505f-1632-4f35-845c-f181eebbd6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.027414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:28.029411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:28.036594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 202/404] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:27 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:28.036594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.051300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-be68505f-1632-4f35-845c-f181eebbd6f9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:28.052569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-be68505f-1632-4f35-845c-f181eebbd6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:28.122600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 203/405] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:28.127790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68505f-1632-4f35-845c-f181eebbd6f9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.177564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faf68b-62b7-44c8-82ce-c2ad75ea40f1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:28.203976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:28.217469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.218273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.218623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.218963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.219825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:28.220215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:28.221661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:28.230667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 203/406] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:28.234282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.243948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68505f-1632-4f35-845c-f181eebbd6f9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:28.280100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.281296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.281768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.282226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/groups/1620f332e6d140249d6264825ff4fc2f/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.284518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] RBAC: Authorizing `identity:create_grant(project_id=2c752f18e50e43f0a2ee057c963e0fa2, group_id=1620f332e6d140249d6264825ff4fc2f, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:28.286702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:28.291939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:28.303739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 204/407] 10.222.0.78 () {58 vars in 1442 bytes} [Mon Jul 4 09:56:28 2022] PUT /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/groups/1620f332e6d140249d6264825ff4fc2f/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:28.305200 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.377467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3db921-adcb-4fd7-9767-5e8ec7a4e5ae None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:28.428567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833a0a8-9ccf-44b8-b0ae-012d8adcc48f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:28.454798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.456077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.456570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.457043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.471239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:28.481713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:28.482709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:28.483541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:28.487244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 204/408] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:28.493443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.509374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.510705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.511216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.511837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.515317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:28.517098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:28.521530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 205/409] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:28 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:28.527540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.569648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:28.590564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:28.681831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83617b87-352e-4f95-a42a-c2c224724c23 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:28.720209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61858e-d0fb-4331-a467-fef834590cb6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:28.747886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.748558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.748837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.749105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.749855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:28.750158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:28.751534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:28.771305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 205/410] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:28.778934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.795939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.796884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.797162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.797473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.798677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:28.803690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:28.808739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 206/411] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:28 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:28.811240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:28.933184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:28.950476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917ad0-c01f-45d6-870d-f211494d178b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:28.986518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:28.988290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:28.988777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:28.989772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/groups/1620f332e6d140249d6264825ff4fc2f/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:28.992294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c752f18e50e43f0a2ee057c963e0fa2, group_id=1620f332e6d140249d6264825ff4fc2f, role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:28.994255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:29.009232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d7c2-7302-410f-a33f-9240e4b6f95d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:29.011334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 207/412] 10.222.0.78 () {58 vars in 1442 bytes} [Mon Jul 4 09:56:28 2022] PUT /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2/groups/1620f332e6d140249d6264825ff4fc2f/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:29.023326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:29.053912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:29.055127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:29.055662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:29.056153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] PATH_INFO: `/v3/groups/f19daa190bb34718997eb392f3ea61d2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:29.057648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] RBAC: Authorizing `identity:get_group(group_id=f19daa190bb34718997eb392f3ea61d2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:29.059373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:29.065187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 206/413] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:28 2022] GET /identity/v3/groups/f19daa190bb34718997eb392f3ea61d2 => generated 229 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:29.068440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:29.187989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c473-e484-4b8e-a852-8e0d30440231 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:29.240736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257aa4-40e8-43eb-b01e-36428d3e8f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:29.241113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257aa4-40e8-43eb-b01e-36428d3e8f1e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:29.241403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257aa4-40e8-43eb-b01e-36428d3e8f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:29.241678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257aa4-40e8-43eb-b01e-36428d3e8f1e None admin] PATH_INFO: `/v3/projects/b97d6692af504c1fa68b44270187348b` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:29.243527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257aa4-40e8-43eb-b01e-36428d3e8f1e None admin] RBAC: Authorizing `identity:get_project(project_id=b97d6692af504c1fa68b44270187348b)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:29.244970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257aa4-40e8-43eb-b01e-36428d3e8f1e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:29.246830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 208/414] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:29 2022] GET /identity/v3/projects/b97d6692af504c1fa68b44270187348b => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:29.252661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:29.375648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904457c-d988-4cb5-ae25-e3fc3f3b2608 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:29.417247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4962d-4c3f-4d9c-a453-519ebe9dea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:29.418139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4962d-4c3f-4d9c-a453-519ebe9dea54 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:29.418424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4962d-4c3f-4d9c-a453-519ebe9dea54 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:29.418699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4962d-4c3f-4d9c-a453-519ebe9dea54 None admin] PATH_INFO: `/v3/projects/b97d6692af504c1fa68b44270187348b/groups/f19daa190bb34718997eb392f3ea61d2/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:29.423604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4962d-4c3f-4d9c-a453-519ebe9dea54 None admin] RBAC: Authorizing `identity:create_grant(project_id=b97d6692af504c1fa68b44270187348b, group_id=f19daa190bb34718997eb392f3ea61d2, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:29.425058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4962d-4c3f-4d9c-a453-519ebe9dea54 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:29.464220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 207/415] 10.222.0.78 () {58 vars in 1442 bytes} [Mon Jul 4 09:56:29 2022] PUT /identity/v3/projects/b97d6692af504c1fa68b44270187348b/groups/f19daa190bb34718997eb392f3ea61d2/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:29.501653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369ebb-aaf1-4035-a880-d6fe9bd29bde None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:29.501990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369ebb-aaf1-4035-a880-d6fe9bd29bde None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:29.502267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369ebb-aaf1-4035-a880-d6fe9bd29bde None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:29.503827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 209/416] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:29.513644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd753d01-28d1-4a15-b38a-92118b22e159 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:29.513950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd753d01-28d1-4a15-b38a-92118b22e159 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:29.514199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd753d01-28d1-4a15-b38a-92118b22e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:29.532777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-fd753d01-28d1-4a15-b38a-92118b22e159 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:29.534156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-fd753d01-28d1-4a15-b38a-92118b22e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:29.580498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:29.627410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 208/417] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:29.655824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7369ebb-aaf1-4035-a880-d6fe9bd29bde None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:29.675308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:29.783747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7369ebb-aaf1-4035-a880-d6fe9bd29bde None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:29.827159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2993-6c72-4f93-aae5-6440eeecb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:29.829024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2993-6c72-4f93-aae5-6440eeecb957 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:29.829024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2993-6c72-4f93-aae5-6440eeecb957 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:29.829024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2993-6c72-4f93-aae5-6440eeecb957 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:29.849294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba2993-6c72-4f93-aae5-6440eeecb957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-37ba2993-6c72-4f93-aae5-6440eeecb957 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:29.857383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:29.858280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:29.859088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:29.864541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 210/418] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:29.871007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd753d01-28d1-4a15-b38a-92118b22e159 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:30.037820 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d5b-46ed-4ba7-9ec0-945fa6526aa1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.038305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d5b-46ed-4ba7-9ec0-945fa6526aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.038305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d5b-46ed-4ba7-9ec0-945fa6526aa1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.040316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 211/419] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:30.049018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f6f5a-256d-4901-9bc6-505ba92d3eda None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.049310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f6f5a-256d-4901-9bc6-505ba92d3eda None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.049594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f6f5a-256d-4901-9bc6-505ba92d3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.084576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ae3f6f5a-256d-4901-9bc6-505ba92d3eda None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:30.085795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ae3f6f5a-256d-4901-9bc6-505ba92d3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:30.086444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd753d01-28d1-4a15-b38a-92118b22e159 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:30.128066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:30.128741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.129021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.129292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.130603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:30.130912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:30.132306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:30.150481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 209/420] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:30.156495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:30.217466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:30.238569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 212/421] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:30.306856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f6f5a-256d-4901-9bc6-505ba92d3eda None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:30.314852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5a6db-be93-45c4-804b-95e2d23bddd7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:30.318647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:30.353558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:30.354217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.354498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.354773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.429096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:30.431058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:30.467998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:30.537463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 210/422] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:30.544699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f6f5a-256d-4901-9bc6-505ba92d3eda None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:30.546465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:30.624173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:30.625003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.625285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.625556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.654371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:30.665768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:30.666679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:30.667513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:30.671729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 213/423] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:30.683276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:30.753529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc4462-0a53-4903-a2b3-ee9e8bba95d4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:30.812251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:30.814613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:30.821830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81c066-4a59-4a3b-bf38-9bdf29f25b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:30.822809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c066-4a59-4a3b-bf38-9bdf29f25b8b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.823846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c066-4a59-4a3b-bf38-9bdf29f25b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.824222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c066-4a59-4a3b-bf38-9bdf29f25b8b None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.825954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81c066-4a59-4a3b-bf38-9bdf29f25b8b None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:30.827344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81c066-4a59-4a3b-bf38-9bdf29f25b8b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:30.829707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 211/424] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:30 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:30.831360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1587652-7737-4ed7-b4fd-b3d1a2535f55 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.831722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1587652-7737-4ed7-b4fd-b3d1a2535f55 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.832061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1587652-7737-4ed7-b4fd-b3d1a2535f55 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.838362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 212/425] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:30.838362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1587652-7737-4ed7-b4fd-b3d1a2535f55 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:30.883761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48188-ded0-46ba-95a6-855b361c1cb8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:30.937120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a453-8496-4893-ae40-9113be3e61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:30.938073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a453-8496-4893-ae40-9113be3e61fe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.938515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a453-8496-4893-ae40-9113be3e61fe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.938939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a453-8496-4893-ae40-9113be3e61fe None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.940386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a453-8496-4893-ae40-9113be3e61fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:30.941178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a453-8496-4893-ae40-9113be3e61fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:30.943467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a453-8496-4893-ae40-9113be3e61fe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:30.952945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1587652-7737-4ed7-b4fd-b3d1a2535f55 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:30.956605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 214/426] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:30.958114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da949f-b5cf-4e9f-ad37-880d5d8377ca None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.958538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da949f-b5cf-4e9f-ad37-880d5d8377ca None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.958946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da949f-b5cf-4e9f-ad37-880d5d8377ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.980950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-75da949f-b5cf-4e9f-ad37-880d5d8377ca None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:30.982638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-75da949f-b5cf-4e9f-ad37-880d5d8377ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:30.994588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:30.995546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:30.995947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:30.996317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:30.997892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:30.999497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:31.001639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 213/427] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:30 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:31.002897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.075837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:31.076163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 215/428] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:31.077588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da949f-b5cf-4e9f-ad37-880d5d8377ca None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.118407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050ef7-a104-47a5-8fe1-fb42091d3fc7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:31.157575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:31.158252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.158534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.158808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.166284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:31.216475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da949f-b5cf-4e9f-ad37-880d5d8377ca None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:31.235873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:31.237343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:31.257021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:31.258045 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.258533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.259052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.260123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=175a398948844db0b21c22ce03469d75) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:31.260636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:31.262270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:31.269085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 216/429] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:31.270949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.307566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:31.354344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 214/430] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:31.359986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.386776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf7e2-cce2-4901-b02f-8e49339899cc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:31.409606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:31.443605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:31.444994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.445485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.446131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.466808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:31.473860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3375b3-01a5-451c-a4b7-1a4aa07b0fbc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:31.478081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:31.478976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 09:56:31.479818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:31.485470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 217/431] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:31.491369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.513392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:31.514201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.514478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.514751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] PATH_INFO: `/v3/projects/175a398948844db0b21c22ce03469d75` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.515964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] RBAC: Authorizing `identity:get_project(project_id=175a398948844db0b21c22ce03469d75)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:31.524134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:31.524134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 215/432] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/projects/175a398948844db0b21c22ce03469d75 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:31.525860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.563139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:31.659480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd51fd8-4246-424a-a5a3-3fa3e09b5b06 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:31.676884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e61f7a-b643-4089-a13d-30c9a4fd2afa None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:31.707085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e678eec-d74d-4dc7-b04a-b70c1f43b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:31.708586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678eec-d74d-4dc7-b04a-b70c1f43b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.708867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678eec-d74d-4dc7-b04a-b70c1f43b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.709140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678eec-d74d-4dc7-b04a-b70c1f43b0b3 None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.710381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e678eec-d74d-4dc7-b04a-b70c1f43b0b3 None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:31.711877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e678eec-d74d-4dc7-b04a-b70c1f43b0b3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:31.713512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 216/433] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:31.716926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1405bcf-5943-469f-90b7-e13e10e11b08 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.717320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1405bcf-5943-469f-90b7-e13e10e11b08 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.717699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1405bcf-5943-469f-90b7-e13e10e11b08 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.718711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd267-be31-47c0-8edc-ccef665ceaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:31.719235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 217/434] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:31.719518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd267-be31-47c0-8edc-ccef665ceaaf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.720015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1405bcf-5943-469f-90b7-e13e10e11b08 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.723688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd267-be31-47c0-8edc-ccef665ceaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.724006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd267-be31-47c0-8edc-ccef665ceaaf None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.724800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd267-be31-47c0-8edc-ccef665ceaaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:31.725115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd267-be31-47c0-8edc-ccef665ceaaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:31.726522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd267-be31-47c0-8edc-ccef665ceaaf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:31.736741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 218/435] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:31.738382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dedbbb-974b-4b3b-9b88-a1b67159c2d9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.738915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dedbbb-974b-4b3b-9b88-a1b67159c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.739383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dedbbb-974b-4b3b-9b88-a1b67159c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.764394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d7dedbbb-974b-4b3b-9b88-a1b67159c2d9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:31.765596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d7dedbbb-974b-4b3b-9b88-a1b67159c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:31.807680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:31.850295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 219/436] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:31.851332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dedbbb-974b-4b3b-9b88-a1b67159c2d9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.852537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:31.857362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1405bcf-5943-469f-90b7-e13e10e11b08 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:31.903762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607aea-3f22-49e4-afb0-f2d61f9b0ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:31.904477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607aea-3f22-49e4-afb0-f2d61f9b0ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.904765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607aea-3f22-49e4-afb0-f2d61f9b0ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.905042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607aea-3f22-49e4-afb0-f2d61f9b0ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.905890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607aea-3f22-49e4-afb0-f2d61f9b0ee1 None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=175a398948844db0b21c22ce03469d75) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:31.906203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607aea-3f22-49e4-afb0-f2d61f9b0ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:31.907676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607aea-3f22-49e4-afb0-f2d61f9b0ee1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:31.913934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 218/437] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=175a398948844db0b21c22ce03469d75&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:31.915292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070087d-bc24-4650-aaac-615ce9108159 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:31.915617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070087d-bc24-4650-aaac-615ce9108159 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:31.916855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070087d-bc24-4650-aaac-615ce9108159 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:31.918229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 219/438] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:31.918973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070087d-bc24-4650-aaac-615ce9108159 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:31.995422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dedbbb-974b-4b3b-9b88-a1b67159c2d9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.033040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.033804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.034255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.034702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.053792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070087d-bc24-4650-aaac-615ce9108159 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.084003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.097499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00114977-9128-410a-b4f6-1226525fb7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.098590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114977-9128-410a-b4f6-1226525fb7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.099012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114977-9128-410a-b4f6-1226525fb7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.099436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114977-9128-410a-b4f6-1226525fb7e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.115701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00114977-9128-410a-b4f6-1226525fb7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:32.119935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.121457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-00114977-9128-410a-b4f6-1226525fb7e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:32.124246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:32.125142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:32.126342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 220/439] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:32.127014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add7a7-4238-404d-9677-6eecb0348519 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.127256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add7a7-4238-404d-9677-6eecb0348519 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.127534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add7a7-4238-404d-9677-6eecb0348519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.147056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-85add7a7-4238-404d-9677-6eecb0348519 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:32.148315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-85add7a7-4238-404d-9677-6eecb0348519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:32.170837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.234427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 221/440] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:32.235281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add7a7-4238-404d-9677-6eecb0348519 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.261360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 220/441] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:32.262221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.339760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.346095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add7a7-4238-404d-9677-6eecb0348519 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.370639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e3372-cab7-4047-bc88-ff00716b564b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.380064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.380735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.381013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.381283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.382051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:32.386317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.387903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.396694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 222/442] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:32.397501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.405460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.406264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.406548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.406825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.415402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.417163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:32.424985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:32.426630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 221/443] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:32.428170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.501463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73587e9-44e7-4b6e-ac5b-7c9238855446 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.528232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c216a03-3f65-4ebd-a7b8-9d77a5062480 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.536205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.537067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.537345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.537619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.538799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.540281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.541964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 223/444] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:32.542718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.565901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.571812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.572481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.572761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.573038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.632292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.640914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.642444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.649157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fbaa0-31e1-49f6-9487-b9b071697b2c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.684190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.684781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.685064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.685343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.686158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:32.686428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.687820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.696133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 224/445] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:32.696928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.747672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 222/446] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:32.748808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.778626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.799538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8480a-81df-4ff5-b858-2bad812c9065 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.831826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.833255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.833546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.833816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.835002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.836489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.838113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 225/447] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:32.838871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.850023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b58cc6-c4db-4757-96b1-a6beefcc4314 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.854954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:32.887268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.887971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.888258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.888540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.939187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5cd38-339e-48d5-a351-53ebaa5346cb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:32.954924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.956501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.972195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:32.973588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:32.973941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:32.974211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] PATH_INFO: `/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:32.975333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] RBAC: Authorizing `identity:get_project(project_id=2c752f18e50e43f0a2ee057c963e0fa2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:32.976828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:32.978684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 226/448] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/projects/2c752f18e50e43f0a2ee057c963e0fa2 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:32.979272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:32.987447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:33.059153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 223/449] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:33.060228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:33.065014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:33.085271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1eb05-bff8-4dad-91ff-5198d7775ebc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:33.118857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:33.119510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:33.119824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:33.120112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:33.120939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=b70d42d686f74daf87804f3a36b591a5, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:33.121253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:33.122676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:33.128800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 227/450] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:32 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=b70d42d686f74daf87804f3a36b591a5 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:33.129604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:33.172174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb4d6-9d86-4173-8af2-93e7f79f6b38 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:33.211932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:33.218509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:33.219398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:33.219715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:33.220025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] PATH_INFO: `/v3/groups/1620f332e6d140249d6264825ff4fc2f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:33.222144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] RBAC: Authorizing `identity:get_group(group_id=1620f332e6d140249d6264825ff4fc2f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:33.224023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:33.231895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 224/451] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:33 2022] GET /identity/v3/groups/1620f332e6d140249d6264825ff4fc2f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:33.232708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:33.250450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55707d0c-f15a-4c08-87b1-4b1bc9f34230 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:33.289820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:33.292137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:33.292573 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:33.292847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] PATH_INFO: `/v3/projects/b97d6692af504c1fa68b44270187348b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:33.294490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=b97d6692af504c1fa68b44270187348b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:33.295968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:33.300318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 228/452] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:56:33 2022] GET /identity/v3/projects/b97d6692af504c1fa68b44270187348b => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:33.304277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:33.324792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:33.356672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d3cb-8815-43bc-be11-e943cd2d386e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:33.394115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:33.394780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:33.395094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:33.395371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:33.396253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] RBAC: Adding query filter params (group.id=1620f332e6d140249d6264825ff4fc2f, role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:33.399393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:33.399393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:33.405385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 225/453] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:33 2022] GET /identity/v3/role_assignments?group.id=1620f332e6d140249d6264825ff4fc2f&scope.project.id=2c752f18e50e43f0a2ee057c963e0fa2&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:33.432771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263641f3-fc09-4ac6-8a8f-de07afe14eb4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:33.473933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48150631-a7ce-4ba0-87b9-15db1ae028ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:33.474724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48150631-a7ce-4ba0-87b9-15db1ae028ed None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:33.475002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48150631-a7ce-4ba0-87b9-15db1ae028ed None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:33.475271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48150631-a7ce-4ba0-87b9-15db1ae028ed None admin] PATH_INFO: `/v3/groups/f19daa190bb34718997eb392f3ea61d2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:33.476572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48150631-a7ce-4ba0-87b9-15db1ae028ed None admin] RBAC: Authorizing `identity:get_group(group_id=f19daa190bb34718997eb392f3ea61d2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:33.478074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48150631-a7ce-4ba0-87b9-15db1ae028ed None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:33.480244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 229/454] 10.222.0.78 () {56 vars in 1180 bytes} [Mon Jul 4 09:56:33 2022] GET /identity/v3/groups/f19daa190bb34718997eb392f3ea61d2 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:33.486171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:33.555263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:33.599715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6286383-086c-45e7-b58f-8fc5ca8b3c6f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:33.634575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54493d4f-ff83-4e66-afb0-80ab2652c1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:33.635250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54493d4f-ff83-4e66-afb0-80ab2652c1da None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:33.635537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54493d4f-ff83-4e66-afb0-80ab2652c1da None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:33.635845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54493d4f-ff83-4e66-afb0-80ab2652c1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:33.636694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54493d4f-ff83-4e66-afb0-80ab2652c1da None admin] RBAC: Adding query filter params (group.id=f19daa190bb34718997eb392f3ea61d2, role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=b97d6692af504c1fa68b44270187348b) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:33.637013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54493d4f-ff83-4e66-afb0-80ab2652c1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:33.638448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54493d4f-ff83-4e66-afb0-80ab2652c1da None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:33.644519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 226/455] 10.222.0.78 () {56 vars in 1376 bytes} [Mon Jul 4 09:56:33 2022] GET /identity/v3/role_assignments?group.id=f19daa190bb34718997eb392f3ea61d2&scope.project.id=b97d6692af504c1fa68b44270187348b&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:36.101505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec325-1afc-42e1-8836-f59e5162e4c6 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.102030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec325-1afc-42e1-8836-f59e5162e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.102491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ec325-1afc-42e1-8836-f59e5162e4c6 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.105408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 230/456] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:36.114556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812164c-1be5-4eca-a230-cf4f0c4dccba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.115913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812164c-1be5-4eca-a230-cf4f0c4dccba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.116653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812164c-1be5-4eca-a230-cf4f0c4dccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.144921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9812164c-1be5-4eca-a230-cf4f0c4dccba None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:36.147341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9812164c-1be5-4eca-a230-cf4f0c4dccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:36.270671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00510631-ded1-44db-833a-1a1f1f0abd5b None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.271385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00510631-ded1-44db-833a-1a1f1f0abd5b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.272085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00510631-ded1-44db-833a-1a1f1f0abd5b None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.277520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 231/457] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:36.279392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17664d33-1097-425c-8413-efc6976be2f1 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.279872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17664d33-1097-425c-8413-efc6976be2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.280369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17664d33-1097-425c-8413-efc6976be2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.295984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 227/458] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:36.317235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-17664d33-1097-425c-8413-efc6976be2f1 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:36.318796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-17664d33-1097-425c-8413-efc6976be2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:36.348271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812164c-1be5-4eca-a230-cf4f0c4dccba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:36.480193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:36.484198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 232/459] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:36.486731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d49fe-a3d3-4d0e-975a-1d99dac0372c None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.487237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d49fe-a3d3-4d0e-975a-1d99dac0372c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.487745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d49fe-a3d3-4d0e-975a-1d99dac0372c None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.490876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 233/460] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:36.496686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1b040-9312-4369-a45c-2aefac91ca80 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.497684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1b040-9312-4369-a45c-2aefac91ca80 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.498387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1b040-9312-4369-a45c-2aefac91ca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.515938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812164c-1be5-4eca-a230-cf4f0c4dccba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:36.555431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e2b1b040-9312-4369-a45c-2aefac91ca80 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:36.557385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e2b1b040-9312-4369-a45c-2aefac91ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:36.560881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:36.563785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.564571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.565354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.570949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:36.601190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:36.606007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:36.641774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 234/461] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:36.642768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1b040-9312-4369-a45c-2aefac91ca80 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:36.653653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:36.655493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:36.657492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:36.657492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:36.657492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:36.657492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:36.662840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 228/462] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:36.671853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:36.768428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1b040-9312-4369-a45c-2aefac91ca80 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:36.799694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7f74-8df9-4088-ac7b-08b0ceee8dc7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:36.809932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:36.811001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.811385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.811786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.812460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:36.825477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:36.826954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:36.829079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:36.841348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:36.842012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.842293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.842568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:36.843299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:36.843639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:36.845023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:36.849033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:36.849907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:36.850761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:36.850761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:36.850761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:36.850761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:36.850761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 235/463] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:36.851465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:36.858684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 229/464] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:36.859527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:36.962672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358b22a-4995-452f-9ec8-8aafe9fb2db1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:36.963025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63e94-70c7-4e8a-b5d0-6761481129ce None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:36.998031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:36.998702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:36.998984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:36.999256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.000025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:37.000331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.000914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:37.001694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.001861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.002022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.002238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.014004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.015096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 230/465] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:37.015495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.015940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:37.035264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:37.037292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:37.039544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:37.039544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:37.039544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:37.039544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:37.039544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 236/466] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:37.039544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:37.051531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:37.090922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:37.123338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79990-3fb6-4454-b74f-cdabdf3afd0b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:37.151993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d59a1-9900-4e05-a5ae-ff25bf907cff None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:37.164369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:37.165554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.165987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.166612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.167963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.170079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.192383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaa1b8-28d4-499c-ba3a-53804b89501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:37.193166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa1b8-28d4-499c-ba3a-53804b89501e None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.193448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa1b8-28d4-499c-ba3a-53804b89501e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.193768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa1b8-28d4-499c-ba3a-53804b89501e None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.194573 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaa1b8-28d4-499c-ba3a-53804b89501e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.196198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaa1b8-28d4-499c-ba3a-53804b89501e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.198289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 231/467] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:37 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:37.199265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:37.249544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 237/468] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:37 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:37.250963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474510c-27df-48e2-9e87-64aae3be1238 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.251256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474510c-27df-48e2-9e87-64aae3be1238 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.251554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474510c-27df-48e2-9e87-64aae3be1238 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.258580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 238/469] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:37.260109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148a2d-ad06-4dd2-8327-7c55de19eaf4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.260408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148a2d-ad06-4dd2-8327-7c55de19eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.260695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148a2d-ad06-4dd2-8327-7c55de19eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.284187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c6148a2d-ad06-4dd2-8327-7c55de19eaf4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:37.286568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c6148a2d-ad06-4dd2-8327-7c55de19eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:37.322664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:37.346817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7453239-f7d3-4d9a-8e6a-6c51e495ee8a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:37.406274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 239/470] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:37.425796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:37.427089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.427381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.427950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.428721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:37.429036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.430475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.448047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 232/471] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:37.454289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148a2d-ad06-4dd2-8327-7c55de19eaf4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:37.454641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:37.497311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:37.605113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9173e04-9d3e-4704-b419-08dfcf66a960 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:37.620570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148a2d-ad06-4dd2-8327-7c55de19eaf4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:37.646666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:37.647480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.647798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.648076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.657575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:37.658264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.658582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.658955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.659737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.660251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.661261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.661712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.668770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:37.683214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:37.684234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:37.685094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:37.685094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:37.685094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:37.685094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:37.685094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 233/472] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:37.685372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 240/473] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:37 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:37.697035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:37.859930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5a3d4-c84d-425e-aaac-957311f9ca27 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:37.896590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454922e-93cf-487c-8d39-19b834f33059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:37.897265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454922e-93cf-487c-8d39-19b834f33059 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:37.897548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454922e-93cf-487c-8d39-19b834f33059 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:37.897825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454922e-93cf-487c-8d39-19b834f33059 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:37.898555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454922e-93cf-487c-8d39-19b834f33059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:37.898865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454922e-93cf-487c-8d39-19b834f33059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:37.900282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454922e-93cf-487c-8d39-19b834f33059 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:37.914348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 234/474] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:37.919830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:38.012875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb3e19-24cc-4e90-82fe-5961f0f7823d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:38.013183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb3e19-24cc-4e90-82fe-5961f0f7823d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:38.013446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb3e19-24cc-4e90-82fe-5961f0f7823d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:38.014968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 235/475] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:56:38.020877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160188-5ec8-4bfa-80cb-b9597635b863 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:38.020877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160188-5ec8-4bfa-80cb-b9597635b863 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:38.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160188-5ec8-4bfa-80cb-b9597635b863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:38.026625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:38.042046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e354f2-25a8-4bdb-9dc4-eb5f25bb56e3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:38.044595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1a160188-5ec8-4bfa-80cb-b9597635b863 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:38.045993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1a160188-5ec8-4bfa-80cb-b9597635b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:38.088791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:38.089498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:38.089819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:38.090138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:38.092461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:38.092461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:38.121223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 241/476] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:37 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:56:38.128174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:38.153219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 236/477] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:38.188583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:38.306479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cbb57-4acc-46a3-905c-16a91c19f58e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:38.345656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:38.346597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:38.347027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:38.348206 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:38.349166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:38.350694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:38.362995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.sql.core [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:56:38.362995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 09:56:38.362995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [parameters: {'id': '6dfbcc865e8247b98358eb76cc9df045', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 09:56:38.362995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80354) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result.read() Jul 04 09:56:38.381509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return ref.to_dict() Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:56:38.382733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application yield resource Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise self.value Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application session.commit() Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:56:38.383955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:56:38.385051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:56:38.386151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result.read() Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:56:38.387158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [parameters: {'id': '6dfbcc865e8247b98358eb76cc9df045', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:38.388101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 09:56:38.389099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:38.391959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 242/478] 10.222.0.78 () {60 vars in 1131 bytes} [Mon Jul 4 09:56:38 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:38.399780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160188-5ec8-4bfa-80cb-b9597635b863 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:38.527421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160188-5ec8-4bfa-80cb-b9597635b863 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:38.578304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d9e1-63fe-4084-adcd-55f3b915ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:38.580182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d9e1-63fe-4084-adcd-55f3b915ec15 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:38.580182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d9e1-63fe-4084-adcd-55f3b915ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:38.580182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d9e1-63fe-4084-adcd-55f3b915ec15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:38.596249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d9e1-63fe-4084-adcd-55f3b915ec15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b149d9e1-63fe-4084-adcd-55f3b915ec15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:38.604989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:38.606119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 09:56:38.607151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:38.609615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 237/479] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:56:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:38.615082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:38.632014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:38.773334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b003f7a-23ee-47b5-9fbc-d02c28a478a8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:38.817511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f1d7b-ec1c-4764-be85-7614ec071444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:38.818208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f1d7b-ec1c-4764-be85-7614ec071444 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:38.818549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f1d7b-ec1c-4764-be85-7614ec071444 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:38.818946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f1d7b-ec1c-4764-be85-7614ec071444 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:38.820398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f1d7b-ec1c-4764-be85-7614ec071444 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:38.820935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f1d7b-ec1c-4764-be85-7614ec071444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:38.822520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f1d7b-ec1c-4764-be85-7614ec071444 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:38.833246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 243/480] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:39.855207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565a579-df2f-42ba-86d7-43982e01aec1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:39.855207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565a579-df2f-42ba-86d7-43982e01aec1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:39.855207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565a579-df2f-42ba-86d7-43982e01aec1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:39.856424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 238/481] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:39.862045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a1785-873a-4cd5-a614-092954773156 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:39.862487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a1785-873a-4cd5-a614-092954773156 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:39.862684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a1785-873a-4cd5-a614-092954773156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:39.891620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ee6a1785-873a-4cd5-a614-092954773156 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:39.892838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ee6a1785-873a-4cd5-a614-092954773156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:39.990259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:39.999274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 244/482] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:40.073375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565a579-df2f-42ba-86d7-43982e01aec1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:40.143523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:40.206479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aab993-fc8e-45bd-978d-608cddac2ea8 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.206801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aab993-fc8e-45bd-978d-608cddac2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.207915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aab993-fc8e-45bd-978d-608cddac2ea8 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.209316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 245/483] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:56:40.215039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfde2d-9082-43d9-9484-422f02481c99 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.215664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfde2d-9082-43d9-9484-422f02481c99 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.216139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfde2d-9082-43d9-9484-422f02481c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.223613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565a579-df2f-42ba-86d7-43982e01aec1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:40.251228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-22dfde2d-9082-43d9-9484-422f02481c99 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:40.253791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-22dfde2d-9082-43d9-9484-422f02481c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:40.279486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:40.280685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.281182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.281653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.302394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:40.311510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:40.312414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:40.313316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:40.322690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 239/484] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:40.333147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:40.381412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 246/485] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:40.454168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe51ef-ce30-4a02-a4e5-1f6576008767 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.454480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe51ef-ce30-4a02-a4e5-1f6576008767 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.454731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe51ef-ce30-4a02-a4e5-1f6576008767 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.456158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 247/486] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:56:40.463349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231ddf-4acd-4476-bba6-a02cb16ba1fc None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.463668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231ddf-4acd-4476-bba6-a02cb16ba1fc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.463951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231ddf-4acd-4476-bba6-a02cb16ba1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.482314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-22231ddf-4acd-4476-bba6-a02cb16ba1fc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:40.483512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-22231ddf-4acd-4476-bba6-a02cb16ba1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:40.495523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da283c-328a-4ad9-9b32-e91df3329d55 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:40.506597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:40.541051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:40.541733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.542021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.542675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.543035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:40.543343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:40.544754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:40.553742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 240/487] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:40.554565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:40.583936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 248/488] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:40.583936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22231ddf-4acd-4476-bba6-a02cb16ba1fc None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:40.671440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:40.696492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a79c-d3a4-4fbf-a15a-9d3595eea726 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:40.728051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22231ddf-4acd-4476-bba6-a02cb16ba1fc None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:40.742005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:40.742982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.743343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.744116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.758143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:40.772234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:40.773366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:40.773819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:40.774721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 241/489] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:40.780615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:40.782571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.783183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.803108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:40.806909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:40.814479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:40.849132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:40.850773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:40.853812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:40.853812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:40.853812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:40.853812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:40.853812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 249/490] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:40.853812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:40.919270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4450694-a6d5-4b52-b778-585d9daa3673 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:40.956520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:40.958193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:40.958736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:40.959194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:40.970608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc917b0-af9f-47a5-af20-af2e789a05f5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:40.971094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:40.979325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:40.980278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:40.981100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 242/491] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:40.981783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:40.989147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.016980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ee86c-908c-464a-a507-b7b7a452e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.017821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ee86c-908c-464a-a507-b7b7a452e656 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.018905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ee86c-908c-464a-a507-b7b7a452e656 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.019194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ee86c-908c-464a-a507-b7b7a452e656 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.020541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ee86c-908c-464a-a507-b7b7a452e656 None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:41.020932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ee86c-908c-464a-a507-b7b7a452e656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.022253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ee86c-908c-464a-a507-b7b7a452e656 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.033296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 250/492] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:41.034959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983b4c-0a51-4af4-a22f-b5499484ec10 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.036303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983b4c-0a51-4af4-a22f-b5499484ec10 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.036303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983b4c-0a51-4af4-a22f-b5499484ec10 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.037865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 251/493] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:41.042291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983b4c-0a51-4af4-a22f-b5499484ec10 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.084527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.095136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233b457-2219-45be-8dcf-f4b779202d65 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.132404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.133090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.133366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.133733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.134476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:41.134783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.136205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.149571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 243/494] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:41.154612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.157934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983b4c-0a51-4af4-a22f-b5499484ec10 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.196865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1416c9-fac0-4384-8c64-4f56b408cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.197549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1416c9-fac0-4384-8c64-4f56b408cc1e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.197834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1416c9-fac0-4384-8c64-4f56b408cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.198109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1416c9-fac0-4384-8c64-4f56b408cc1e None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.198866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1416c9-fac0-4384-8c64-4f56b408cc1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:41.199174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1416c9-fac0-4384-8c64-4f56b408cc1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.200607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1416c9-fac0-4384-8c64-4f56b408cc1e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.209696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 252/495] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:41.215219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38068ac-fb98-448b-a72d-5c9b63752de1 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.215685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38068ac-fb98-448b-a72d-5c9b63752de1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.216179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38068ac-fb98-448b-a72d-5c9b63752de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.239757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e38068ac-fb98-448b-a72d-5c9b63752de1 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:41.240899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e38068ac-fb98-448b-a72d-5c9b63752de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:41.273574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.283490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8855568-09b0-48e1-9fba-58fba17f04cd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.315167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 253/496] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:41.316991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38068ac-fb98-448b-a72d-5c9b63752de1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.325359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.326155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.326438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.326713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.338119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.339720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:41.359723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:41.360798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:41.361856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:41.361856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:41.361856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:41.361856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:41.367678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 244/497] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:41.367678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.367678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.438732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38068ac-fb98-448b-a72d-5c9b63752de1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.471224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf586f7-edad-4756-a69b-6f0afc74166e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.473786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.474690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.475076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.475447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.482841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.484429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:41.500992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:41.502135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:56:41.503263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:41.504513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 254/498] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:41.505236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.514504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.515298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.515604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.515875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.528187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.529642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.533264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:41.547259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:41.548421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:41.549479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:41.549479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:41.549479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:41.549479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:41.549479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 245/499] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:41.549479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.622035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a1dd-1539-4061-b93f-234002b2d484 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.622907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.658293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.659093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.659371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.659676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.671765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:41.680018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fca60f-3134-43dc-bf48-34f68dfe31d9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:41.680147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:41.681197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:41.682285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:41.685872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 255/500] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:41.686648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.721749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.722766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.722766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.722963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.723696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:41.724005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.725368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.737478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 246/501] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:41.738795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.773596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.789045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccc26c-352d-4f3b-b0f6-5666274f2af7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.822891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.823558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.823872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.824151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.824989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:41.825302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.826749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.843421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332d810-e84e-48ec-9057-0b7e01beb951 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:41.857756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:41.863783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 256/502] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:41.864605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.882584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae33d5-6793-48d2-8bf7-9993a48c0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:41.883253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae33d5-6793-48d2-8bf7-9993a48c0423 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.883539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae33d5-6793-48d2-8bf7-9993a48c0423 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.883847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae33d5-6793-48d2-8bf7-9993a48c0423 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.884570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae33d5-6793-48d2-8bf7-9993a48c0423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:41.884873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae33d5-6793-48d2-8bf7-9993a48c0423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:41.886237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae33d5-6793-48d2-8bf7-9993a48c0423 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:41.898276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 247/503] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:41.899488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15138a69-c307-4ebf-bf31-7d98e504d590 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:41.899814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15138a69-c307-4ebf-bf31-7d98e504d590 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:41.900105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15138a69-c307-4ebf-bf31-7d98e504d590 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:41.901333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 248/504] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:41.902026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15138a69-c307-4ebf-bf31-7d98e504d590 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:41.969678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5d2d8-630a-471b-89f4-8a52a522e927 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.011891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.012577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.012837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.013118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.013874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:42.014186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.015222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15138a69-c307-4ebf-bf31-7d98e504d590 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.015647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.024811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 257/505] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:42.025548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.034047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.055639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.056445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.056782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.057062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.064170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.065631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:42.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:42.083830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 249/506] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:42.085943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.119855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.131689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb521bb-57af-4b69-a84a-e9f2ec55062b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.165468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.166121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.166414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.166695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.186482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e149e-f773-4680-87d1-8e6dbfbddf37 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.220959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07fc98-5b51-4db2-8033-923ad30f3b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.221755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07fc98-5b51-4db2-8033-923ad30f3b13 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.222033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07fc98-5b51-4db2-8033-923ad30f3b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.222304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07fc98-5b51-4db2-8033-923ad30f3b13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.229763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07fc98-5b51-4db2-8033-923ad30f3b13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.231237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07fc98-5b51-4db2-8033-923ad30f3b13 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.237915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.239568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1e07fc98-5b51-4db2-8033-923ad30f3b13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:42.245823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:42.246711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:42.247661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 250/507] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:42.248230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90e5d-142a-42b3-a1ed-04d078634d04 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.248548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90e5d-142a-42b3-a1ed-04d078634d04 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.248782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90e5d-142a-42b3-a1ed-04d078634d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.249293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.265982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9ef90e5d-142a-42b3-a1ed-04d078634d04 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:42.267187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9ef90e5d-142a-42b3-a1ed-04d078634d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:42.335247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 251/508] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:42.336136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90e5d-142a-42b3-a1ed-04d078634d04 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.343819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 258/509] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:42.344519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.370306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.444905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e505fe-37c0-4e93-8bea-a5bea1af5f18 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.450369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90e5d-142a-42b3-a1ed-04d078634d04 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.452057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.480842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.481508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.481790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.482062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.482895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:42.483201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.484676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.486375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.487174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.487461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.487772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.498397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.499884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.502099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 259/510] 10.222.0.78 () {56 vars in 1137 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:42.502900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:42.522714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:42.523854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:42.524948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:42.524948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:42.524948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:42.524948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:42.525396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 252/511] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:42.526179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.603075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.608195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9d2c-6967-4079-959f-7f53a4b39bef None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.626911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93309d6b-986b-4965-96b0-9d271be95df6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.642799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.643472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.643785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.644065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.644990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:42.645297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.646744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.661127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.661923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.662211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.662493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.664102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 260/512] 10.222.0.78 () {56 vars in 1137 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:42.664904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.673306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.674770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.694178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:42.694923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:42.696386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:42.697290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:42.697290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:42.697290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:42.697290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:42.697290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 253/513] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:42.697555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.776592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821523c-2df9-4b58-9bae-c207904eb3a7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.807117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04922d7-5ebb-40d3-be8e-489f4f60b65f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.812923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.813716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.814004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.814283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.824951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.826438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.834283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.842807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.843456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.843772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.844052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:42.844263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:42.845152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:42.846021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:42.846021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:42.846021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:42.846021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:42.846021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 261/514] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:42.846305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:42.915907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.917300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:42.923872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:42.950580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69807e6-b52d-4d2f-8b7d-83e57ab7890d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:42.983454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:42.984145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:42.984432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:42.984722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:42.985454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:42.985766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:42.987139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.000995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 262/515] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:43.001798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.015318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 254/516] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:43.016040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.043279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.105042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2aacf-7379-4e7c-ad3c-48eb2ffe873a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.116179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c376ef-9575-49df-bb1a-40048da7dc00 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.138458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.139103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.139390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.139698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.142300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.150407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.151070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.151352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.151661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.152391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:43.152700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.154059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.165303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 255/517] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:43.166139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.213394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.214876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.256009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.268141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc707ff-f14e-4f5b-a4cb-68f5ef7de095 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.300426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.301609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.301883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.302154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.303135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:43.303437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.304822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.312877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 263/518] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:43.313529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.316858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 256/519] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:43.317810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.354888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.422000 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f64e9-6901-46e1-afed-e77e4f052a98 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.425003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bccfa-bb85-4746-8a0a-817d50fef1a6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.456107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.456920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.457199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.457491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.459432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.460246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.460530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.460807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.464461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.465926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.470831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.472285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.480562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:43.480890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:43.481823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 264/520] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:43.482985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:43.494273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:43.495311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:43.496256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:43.496256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:43.496256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:43.496256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:43.496256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 257/521] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:43.496525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.581243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.589569 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0df5bb-de7f-438c-97f6-ba6f4fc14f27 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.598771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69bb19-7e49-43e3-a31b-3f04affde864 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.625677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.626470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.626755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.627034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.633811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.634603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.634811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.634901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.635140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.636312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.645702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.647146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:43.650646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:43.651718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:43.652812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:43.655707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 265/522] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:43.656634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:43.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:43.666567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:43.667428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:43.667428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:43.667428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:43.667428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:43.667428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 258/523] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:43.667428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.721044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.762680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447dd1-b660-4afd-847a-5670b172a706 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.768886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52063f-c08a-49cb-9e87-38cc06d32690 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.795984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.796647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.796934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.797209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.797920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.799358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.803088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.803788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.804071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:43.804346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:43.805184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:43.805494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:43.807266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:43.819496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 266/524] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:56:43 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:56:43.820332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.835618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.862470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 259/525] 10.222.0.78 () {56 vars in 1139 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:43.864778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:43.955588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d7aa5-4bb8-4a91-b8c1-5f50b5e01350 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.978058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182827-17ff-49a1-9435-acdcaa2e1136 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:43.991439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:43.999039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:43.999210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:43.999465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.000010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.000418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:44.001267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.002111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.018280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 267/526] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:44.019125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.027023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.027764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.028056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.028333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.030403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:44.030403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.031367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.051752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 260/527] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:44.052864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.105146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:44.137929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9750ac-3e9a-4d17-9674-53d5de2229bd None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.164090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a896c-4bb9-4324-bbd4-174fffcacb4d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.177197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.178129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.178493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.178738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.179415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:44.179785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.181273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.193452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 268/528] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:44.194073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.208687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.209357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.209640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.209928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.252514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:44.285610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.287218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.307814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe461c8-8eb6-4bbf-90de-11ab96c3df7f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.339615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:44.346997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.348924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.349804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.350561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.360505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.362717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:44.383006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:44.384124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:44.384993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:44.390964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 269/529] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:44.390964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.402566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 261/530] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:44.407144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.484864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:44.502366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ed7f5-fc35-4da6-bbd2-2a4359bd3032 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.521358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e6061-b6dd-449a-9c28-8adcfefe2e69 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.539932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.540605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.540888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.541164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.542003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3a63afc7b9514ef7b4d799b1c1538b36) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:44.542318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.543811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.549389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 270/531] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/role_assignments?user.id=3a63afc7b9514ef7b4d799b1c1538b36&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:44.550184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.577342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.578291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.578579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.578857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.587954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.589543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:44.606757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:44.607730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:44.608612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:44.609276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 262/532] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:44.609537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.631670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:44.695818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186173be-de76-4c64-9e0f-471c315c9792 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.741461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f443d9d-aa7f-4b57-874e-ee0f3974d598 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.749336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.750787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.750787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.750787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.751335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:44.751673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.754355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.776136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 271/533] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:44.777088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.800233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:44.810303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.811370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.811685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.812396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.830118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.831686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:44.850791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:44.851739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:44.853638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:44.853638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:44.853638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:44.853638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:44.853638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 263/534] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:44.853638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:44.901765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1c728-8172-4538-bf39-30526bc040a3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:44.918078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:44.950852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:44.951916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:44.952270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:44.952611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:44.953483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:44.954170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:44.957118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:44.981186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 272/535] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:44.981186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:45.005432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d12b2-ab0a-4c71-b363-4c6328ed7426 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:45.046742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:45.047363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:45.047613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:45.047906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:45.048813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=34e1bd13b2094b93b41f10f209660b5c) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:45.049176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:45.050634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:45.063784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 264/536] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/role_assignments?user.id=34e1bd13b2094b93b41f10f209660b5c&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:45.064721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:45.122846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5ae6c-1c86-462f-bf29-4d13ef9a3e3c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:45.179952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:45.180647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:45.180934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:45.181211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:45.181960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:45.182270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:45.183741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:45.196730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:45.205725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 273/537] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:45.213024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:45.275236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:45.295776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f8217-a6a9-4845-88ef-3b69d76a8de1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:45.339460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:45.340076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:45.340362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:45.341503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:45.342358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=4d8bee133d6a4583a31c87aa4d4af927) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:45.342679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:45.344181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:45.352055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 265/538] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:45 2022] GET /identity/v3/role_assignments?user.id=4d8bee133d6a4583a31c87aa4d4af927&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:45.396313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c3ea-194f-4e35-9d41-4a8490c1772a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:45.459841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:45.461019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:45.461514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:45.462045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:45.472991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:45.474799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:45.492700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:45.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:45.494462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:45.496946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 274/539] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:45.502842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:45.646445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc9577-d3a9-40f6-a8e9-5cf07f5274f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:45.663948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:45.701662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8d7b0-ad72-466c-8de3-d9accc3f2e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:45.702336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8d7b0-ad72-466c-8de3-d9accc3f2e51 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:45.702618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8d7b0-ad72-466c-8de3-d9accc3f2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:45.702893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8d7b0-ad72-466c-8de3-d9accc3f2e51 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:45.703711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8d7b0-ad72-466c-8de3-d9accc3f2e51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:45.704019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8d7b0-ad72-466c-8de3-d9accc3f2e51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:45.705438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8d7b0-ad72-466c-8de3-d9accc3f2e51 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:45.724854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 266/540] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:45.731041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:45.869251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:45.875681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af542d-c0f8-4093-aeec-6b81256e96f2 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:45.933633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f6e6b-ec57-4077-874c-21ea9182953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:45.934207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6e6b-ec57-4077-874c-21ea9182953f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:45.934523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6e6b-ec57-4077-874c-21ea9182953f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:45.934808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6e6b-ec57-4077-874c-21ea9182953f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:45.935742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6e6b-ec57-4077-874c-21ea9182953f None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=a5b5399fad924cabaf1d414bbca2c191) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:45.936059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6e6b-ec57-4077-874c-21ea9182953f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:45.937505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6e6b-ec57-4077-874c-21ea9182953f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:45.948061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 275/541] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:45 2022] GET /identity/v3/role_assignments?user.id=a5b5399fad924cabaf1d414bbca2c191&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:46.028650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a9f7-be90-4954-9859-93793ed439d7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:46.029296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a9f7-be90-4954-9859-93793ed439d7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:46.029812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a9f7-be90-4954-9859-93793ed439d7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:46.031885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 267/542] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:46.045328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df7f7a-306c-4e9e-a368-40b365a19a90 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:46.045643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df7f7a-306c-4e9e-a368-40b365a19a90 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:46.045892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df7f7a-306c-4e9e-a368-40b365a19a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:46.067505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f8df7f7a-306c-4e9e-a368-40b365a19a90 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:46.068747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f8df7f7a-306c-4e9e-a368-40b365a19a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:46.167708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 276/543] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:46.219736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a9f7-be90-4954-9859-93793ed439d7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:46.374384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a9f7-be90-4954-9859-93793ed439d7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:46.423181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:46.424014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:46.424300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:46.424581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:46.440815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:46.449205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:46.451205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:46.453087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 268/544] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:46.458899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df7f7a-306c-4e9e-a368-40b365a19a90 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:46.634124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:46.650159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df7f7a-306c-4e9e-a368-40b365a19a90 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:46.700709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:46.701379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:46.701670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:46.701943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:46.702699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:46.703003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:46.704395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:46.719111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 277/545] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:46.727109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:46.774395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:46.860919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8315-0a0a-4351-8cbf-7a1115957655 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:46.903077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:46.904141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:46.904594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:46.905013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:46.922452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:46.924156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:46.952830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:46.953885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:46.954852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:46.954852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:46.954852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:46.954852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:46.956600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 269/546] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:46.968749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:47.151328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280ad4c-8184-48c4-8295-d1655ae27ed0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:47.201180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad12fec-87a3-436b-af3c-fc5b2228f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:47.201945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12fec-87a3-436b-af3c-fc5b2228f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:47.202135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12fec-87a3-436b-af3c-fc5b2228f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:47.202402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12fec-87a3-436b-af3c-fc5b2228f3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:47.203130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad12fec-87a3-436b-af3c-fc5b2228f3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:47.203436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad12fec-87a3-436b-af3c-fc5b2228f3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:47.204823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad12fec-87a3-436b-af3c-fc5b2228f3a9 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:47.220421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 278/547] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:47.228371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:47.324599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:47.345706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d30c4-2870-4e92-beb9-c7e03ca7c18a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:47.387150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:47.388321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:47.388861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:47.389350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:47.403549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:47.405236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:47.426062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16f7f8-c928-4513-958b-4627aff52513 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:47.426736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16f7f8-c928-4513-958b-4627aff52513 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:47.427214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16f7f8-c928-4513-958b-4627aff52513 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:47.429458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 279/548] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:47.434454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10905f6e-6d3c-4053-8cfe-a4e8d9702ff0 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:47.434903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10905f6e-6d3c-4053-8cfe-a4e8d9702ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:47.435344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10905f6e-6d3c-4053-8cfe-a4e8d9702ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:47.440082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:47.441612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:47.443006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 270/549] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:47.451483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:47.488610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-10905f6e-6d3c-4053-8cfe-a4e8d9702ff0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:47.490530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-10905f6e-6d3c-4053-8cfe-a4e8d9702ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:47.499306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:47.711314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 280/550] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:47.735607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10905f6e-6d3c-4053-8cfe-a4e8d9702ff0 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:47.757102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaddfd-98ff-4aa8-832c-afe4edfbc78c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:47.842999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10905f6e-6d3c-4053-8cfe-a4e8d9702ff0 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:47.846085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:47.846980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:47.847451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:47.847889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:47.848883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:47.849335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:47.850918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:47.880262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:47.881319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:47.881756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:47.882180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:47.883737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:47.892452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 271/551] 10.222.0.78 () {56 vars in 1135 bytes} [Mon Jul 4 09:56:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:47.895556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:47.899885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:47.900039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:47.908408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:47.909655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:47.910801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:47.913377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 281/552] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:47.919979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.058682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d80e9-7b2c-4d6e-81be-c4a6e76031c6 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.080230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231f401-ab62-4676-bcba-f16e94b947a3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.102572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b1c03-2388-43ff-9b66-758ed5664a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.103833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1c03-2388-43ff-9b66-758ed5664a03 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.103833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1c03-2388-43ff-9b66-758ed5664a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.104154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b1c03-2388-43ff-9b66-758ed5664a03 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.106035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b1c03-2388-43ff-9b66-758ed5664a03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:48.106035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b1c03-2388-43ff-9b66-758ed5664a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:48.107682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b1c03-2388-43ff-9b66-758ed5664a03 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:48.120644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 282/553] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:48.123782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6722b5-3f0b-44f3-8efc-e5c1b18e9b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.124592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6722b5-3f0b-44f3-8efc-e5c1b18e9b1e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.125333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6722b5-3f0b-44f3-8efc-e5c1b18e9b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.125786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6722b5-3f0b-44f3-8efc-e5c1b18e9b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.126702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4b45-ef78-4de0-af07-f2996273170c None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.127089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4b45-ef78-4de0-af07-f2996273170c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.127484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4b45-ef78-4de0-af07-f2996273170c None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.129904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 283/554] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:48.131692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4b45-ef78-4de0-af07-f2996273170c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.211945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:48.216074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6722b5-3f0b-44f3-8efc-e5c1b18e9b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:48.218370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6722b5-3f0b-44f3-8efc-e5c1b18e9b1e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:48.225474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:48.283451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4b45-ef78-4de0-af07-f2996273170c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.320289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487cfee-ac74-4088-af80-0a31c7807175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.321001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487cfee-ac74-4088-af80-0a31c7807175 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.321284 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487cfee-ac74-4088-af80-0a31c7807175 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.321559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487cfee-ac74-4088-af80-0a31c7807175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.332760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487cfee-ac74-4088-af80-0a31c7807175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:48.334210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487cfee-ac74-4088-af80-0a31c7807175 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:48.339203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 272/555] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:48.340532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78cf16-3402-4e73-aedc-c11da51af1db None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.340831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78cf16-3402-4e73-aedc-c11da51af1db None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.341115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78cf16-3402-4e73-aedc-c11da51af1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-1487cfee-ac74-4088-af80-0a31c7807175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:48.352080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:48.353001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:48.354330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:48.354330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:48.354330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:48.354330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:48.354330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 284/556] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:48.354330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a394d9-99ac-4aa1-88c7-60ad6aadcc36 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.354687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a394d9-99ac-4aa1-88c7-60ad6aadcc36 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.354687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a394d9-99ac-4aa1-88c7-60ad6aadcc36 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.359920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 285/557] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:48.359920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a394d9-99ac-4aa1-88c7-60ad6aadcc36 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.362977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3d78cf16-3402-4e73-aedc-c11da51af1db None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:48.364342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3d78cf16-3402-4e73-aedc-c11da51af1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:48.443473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 273/558] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:48.445184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78cf16-3402-4e73-aedc-c11da51af1db None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.468496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a394d9-99ac-4aa1-88c7-60ad6aadcc36 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.483372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:48.487192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:48.507212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc8036-1092-4527-9eb0-cf92e1bd2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.508294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc8036-1092-4527-9eb0-cf92e1bd2d5b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.508579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc8036-1092-4527-9eb0-cf92e1bd2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.508859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc8036-1092-4527-9eb0-cf92e1bd2d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.520772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc8036-1092-4527-9eb0-cf92e1bd2d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:48.522228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc8036-1092-4527-9eb0-cf92e1bd2d5b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-f6bc8036-1092-4527-9eb0-cf92e1bd2d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:48.540734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:48.542217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:48.543117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:48.543117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:48.543117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:48.543117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:48.543117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 286/559] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:48.543566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692675e-7b41-4c67-8ecb-8f785610b381 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.543880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692675e-7b41-4c67-8ecb-8f785610b381 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.544160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692675e-7b41-4c67-8ecb-8f785610b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.561629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e692675e-7b41-4c67-8ecb-8f785610b381 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:48.562850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e692675e-7b41-4c67-8ecb-8f785610b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:48.579112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78cf16-3402-4e73-aedc-c11da51af1db None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.620120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.621062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.621322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.621515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.622249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:48.622620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:48.623954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:48.634824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 287/560] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:48.641352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 274/561] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:48.641352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.641576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692675e-7b41-4c67-8ecb-8f785610b381 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.744227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:48.752096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692675e-7b41-4c67-8ecb-8f785610b381 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.754771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:48.764422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ba992-c84c-4052-bc63-69a7ddca7709 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.789377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.790197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.790464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.790734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.800811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:48.802082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.803046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.803333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.803639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.804369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:48.804681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:48.806042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:48.808727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:48.809634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:48.810481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 288/562] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:48.811376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.819483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 275/563] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:48.820359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.918336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbc10-7bcf-4f9b-9c51-2b252d879a2b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.920422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ec2da-1e62-4d7e-b353-044b305d97a1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:48.952084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.952876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.953168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.953438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.954735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438401b0-3e41-42e5-8c49-8594b6f05ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:48.955535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438401b0-3e41-42e5-8c49-8594b6f05ced None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.955854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438401b0-3e41-42e5-8c49-8594b6f05ced None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.956129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438401b0-3e41-42e5-8c49-8594b6f05ced None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.962304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:48.963801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:48.966982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438401b0-3e41-42e5-8c49-8594b6f05ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-438401b0-3e41-42e5-8c49-8594b6f05ced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:48.974795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:48.975767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:48.976898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 276/564] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:48.977764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df1b87-ce77-4f8e-b030-7654c4bbda3b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:48.977836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:48.978705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:56:48.980777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:48.981461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df1b87-ce77-4f8e-b030-7654c4bbda3b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:48.981461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df1b87-ce77-4f8e-b030-7654c4bbda3b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:48.981611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 289/565] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:48.981692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 277/566] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:48.981692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df1b87-ce77-4f8e-b030-7654c4bbda3b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.983760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:48.996662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.002822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.085818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962997c-398e-4745-9057-3f49fdda40af None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.088391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df1b87-ce77-4f8e-b030-7654c4bbda3b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.118835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.119502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.119819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.120102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.120845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:49.121156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.121366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482f1a3-3069-4fc4-9333-559ba29b18a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.122155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f1a3-3069-4fc4-9333-559ba29b18a2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.122461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f1a3-3069-4fc4-9333-559ba29b18a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.122554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.122735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f1a3-3069-4fc4-9333-559ba29b18a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.129975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482f1a3-3069-4fc4-9333-559ba29b18a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.131362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 290/567] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:49.131490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482f1a3-3069-4fc4-9333-559ba29b18a2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.132185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8482f1a3-3069-4fc4-9333-559ba29b18a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:49.146148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:49.147111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:49.148085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:49.151713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 278/568] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:49.153376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4ec0-3cb7-4bc9-b602-9268b9ffafa5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.153664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4ec0-3cb7-4bc9-b602-9268b9ffafa5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.153944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4ec0-3cb7-4bc9-b602-9268b9ffafa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.170774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0a0e4ec0-3cb7-4bc9-b602-9268b9ffafa5 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:49.171936 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0a0e4ec0-3cb7-4bc9-b602-9268b9ffafa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:49.211134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.233598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de92b2f-1045-40c7-91cb-6e16d24d3313 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.236171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.240911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 279/569] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:49.241711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4ec0-3cb7-4bc9-b602-9268b9ffafa5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.275104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.275897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.276180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.276454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.277284 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:49.277593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.279016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.296539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 291/570] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:49.297347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.344222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4ec0-3cb7-4bc9-b602-9268b9ffafa5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.378366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.379867 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.380153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.380430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.381187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:49.381498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.382865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.391245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 280/571] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:49.391846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.405900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1001b2-f16b-4c81-9934-c39dbc356d07 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.440033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.441427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.441710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.441979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.444681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.452304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.452694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.454188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:49.471480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:49.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:49.473594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:49.473594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:49.473594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:49.473594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:49.473594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 292/572] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:49.473594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.497550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cc86b-88bc-48af-80e6-36e1f34c4022 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.530889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.531551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.531861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.532140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.532938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:49.533254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.534704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.546492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 281/573] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:49.547280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.577218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81576901-7a36-4fe3-8503-f276760fb4d8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.611445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.612359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.612645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.613520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.623467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:49.631146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:49.632158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:49.633013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 293/574] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:49.633857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.658146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8c50a-9f3a-46a4-b771-f57739bf43a4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.681122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.682007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.695241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.695998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.696289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.696567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.706769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.708253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:49.726199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:49.727152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:49.728488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:49.728488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:49.728488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:49.728488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:49.728488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 282/575] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:49.728488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.735495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab505e0-ccb5-4cb4-9953-10ae8c05a2ef None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.769000 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.769788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.770069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.770345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.781291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.782725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:49.800971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:49.802146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:49.803680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:49.803680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:49.803680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:49.803680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:49.803680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 294/576] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:49.803680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.828933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035dd7-96ad-47db-bd3c-be378addcc3a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.863673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.864275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.864555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.864851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.865531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:49.865835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.867193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.878886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 283/577] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:49.879609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.903217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.906619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd37a2-c9dd-4c88-9bf9-8de4ac975c94 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:49.914358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:49.939953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:49.940607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:49.941408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:49.941696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:49.942505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=323dac67dfab4c95b3c1d6ccc9b0a701) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:49.942811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:49.944269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:49.949631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 295/578] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/role_assignments?user.id=323dac67dfab4c95b3c1d6ccc9b0a701&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:49.950349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:49.994744 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6158674-c9db-4c8e-bf4c-3b561cc8b0f1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.044334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.045415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.045773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.045996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.046759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:50.047065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.048488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.059334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 284/579] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:50.060393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.084969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ecb4d-eeec-41ba-acd8-b5d959bc0739 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.132396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.133069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.133353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.133631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.134367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:50.134831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.136074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.149224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 296/580] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:50.150066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.178472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:50.182125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:50.186454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323218dd-e03e-4551-8319-9fed176194eb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.224090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.224688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.224972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.225249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.225971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:50.226281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.227661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.240607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 285/581] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:50.241434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.274965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d24c2d-2d19-4b3f-959f-7ed7f7e58102 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.313995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.314795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.315077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.315355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.323144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.324654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:50.340677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:50.341866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:50.342830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 297/582] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:50.344011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.356405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e2fc0-9278-4a5b-b59f-61a483077f8c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.392568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.393364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.393647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.394478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.405777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.407228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:50.425586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:50.434318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:50.435433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:50.435433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:50.435433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:50.435433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:50.435433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 286/583] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:50.435433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.446518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:50.454776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:50.474810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff4bf-bc0a-4648-bc5e-e69426e5e344 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.512009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.512805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.513090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.513364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.520567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.522208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:50.539251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:50.540195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:50.541104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 298/584] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:50.541598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.544145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b713-8993-4493-bf93-bb3c9fa6cb9b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.583494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.584333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.584727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.585012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.592958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.594395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:50.609553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:50.610717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:50.611729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 287/585] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:50.612327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.665160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d773f13-f0f9-4308-bc87-634f4d509ba0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.686893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:50.712002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.712674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.712961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.713238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.714075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:50.714382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.715834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.726487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de6d0f-4c4b-4d32-a547-b9ecae68da44 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.733671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 299/586] 10.222.0.78 () {56 vars in 1137 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:50.734524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.737041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:50.768495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.769471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.769955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.770389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.771262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:50.771759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.773304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.785649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 288/587] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:50.786420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.849975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c6fa-ad9b-4ebf-a2ef-51a7c2899f57 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.887677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.888609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.889039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.889467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.890269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:50.890578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.892034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.902062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a660a4b-7fab-435c-bf6a-38c2364c689b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:50.908501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 300/588] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:50.909393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.931265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:50.940054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:50.940499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:50.941337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:50.941616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:50.942463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:50.942775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:50.944223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:50.966432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 289/589] 10.222.0.78 () {56 vars in 1137 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:50.966432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:50.980341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:51.036689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce01108-de48-4140-8268-6f1e0e164d3e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.075784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.076587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.076867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.077143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.085716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c70e-51e7-45f1-828c-fca67ee6484b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.088549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.090013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:51.108104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:51.109138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:51.110047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:51.110047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:51.110047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:51.110047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:51.110047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 301/590] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:51.115303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.124863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.125674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.125954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.126232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.134972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.136572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:51.153063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:51.154020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 290/591] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:51.155004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.204449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:51.234437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6582b-6ecc-4abf-96d8-731b47d228d8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.248498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:51.269871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.270739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08befa-4449-40ae-ae55-17835650fb18 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.270863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.271079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.271358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3a63afc7b9514ef7b4d799b1c1538b36/roles/4ffa6416473b43719c4b6241a1af7b13` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.286740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=3a63afc7b9514ef7b4d799b1c1538b36, role_id=4ffa6416473b43719c4b6241a1af7b13)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.288249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.311603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 302/592] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:51 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3a63afc7b9514ef7b4d799b1c1538b36/roles/4ffa6416473b43719c4b6241a1af7b13 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:51.311603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.325506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.327063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.327415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.328062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.345049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.346686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:51.374303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:51.375721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:51.376698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:51.376698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:51.376698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:51.376698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:51.376698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 291/593] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:51.377491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.432327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0996d-c6d0-4dc1-9c69-9b4b3915877d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.471629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.473250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.473741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.474217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.475171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:51.475709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.477306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.492780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 303/594] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:51.493668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.497620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:51.501742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ba14-1345-4307-83fc-e55ccb4261dc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.522223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:51.549706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.550913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.551445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.551969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.553360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:51.553842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.555497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.582311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 292/595] 10.222.0.78 () {56 vars in 1139 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:51.583553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.606856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c08f1-8c8f-42e2-9d07-e6036f26ee32 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.642187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.642858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.643140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.643418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.644855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:51.645217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.646452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.659061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 304/596] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:51.664714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.722054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819741ac-fb4a-469e-8099-13facad640ef None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.755900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:51.773463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e4390-de63-47af-bcd8-331ce0d2009d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.778053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.779139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.779675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.780164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.790677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.792808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.809208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.809987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.810271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.810547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:51.814115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:51.815011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:51.816534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:51.819292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 293/597] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:51.820925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.821971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.823528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:51.842933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:51.844029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:51.844942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:51.844942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:51.844942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:51.844942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:51.844942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 305/598] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:51.845837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:51.846113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:51.951389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec72c-a05b-4ce9-b9bc-abf5024a65b4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.976400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413472-b152-4391-a1d1-ba9bcb6718f5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:51.988217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:51.989110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:51.989479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:51.989831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:51.997158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:51.998763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:52.013878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:52.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 294/599] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:52.016449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.025411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b9bac-1b4c-4088-8d7b-e1e1003cb78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.026306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9bac-1b4c-4088-8d7b-e1e1003cb78c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.026734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9bac-1b4c-4088-8d7b-e1e1003cb78c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.027153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9bac-1b4c-4088-8d7b-e1e1003cb78c None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.028243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b9bac-1b4c-4088-8d7b-e1e1003cb78c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:52.028558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b9bac-1b4c-4088-8d7b-e1e1003cb78c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:52.029990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b9bac-1b4c-4088-8d7b-e1e1003cb78c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.033483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:52.049492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 306/600] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:52.051131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31843-8d54-4b3a-8ec2-b9e7dd92a538 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.051471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31843-8d54-4b3a-8ec2-b9e7dd92a538 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.051787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31843-8d54-4b3a-8ec2-b9e7dd92a538 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.053430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 307/601] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:52.058180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31843-8d54-4b3a-8ec2-b9e7dd92a538 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.098521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:52.124500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace00c2-cbf4-46a2-9a3e-085964ddafad None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:52.164017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.165132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.165618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.165964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.166822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:52.167168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:52.168706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.171809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31843-8d54-4b3a-8ec2-b9e7dd92a538 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:52.185585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 295/602] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:52.185585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.211618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd78db-1b37-405d-9a57-7e96c3369404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.212274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd78db-1b37-405d-9a57-7e96c3369404 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.212553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd78db-1b37-405d-9a57-7e96c3369404 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.212823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd78db-1b37-405d-9a57-7e96c3369404 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.213603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd78db-1b37-405d-9a57-7e96c3369404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:52.213951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd78db-1b37-405d-9a57-7e96c3369404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:52.215339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd78db-1b37-405d-9a57-7e96c3369404 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.231565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 308/603] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:52.231565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833cd87-0108-4ffb-9191-59d727181559 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.231565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833cd87-0108-4ffb-9191-59d727181559 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.231565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833cd87-0108-4ffb-9191-59d727181559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.246008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7833cd87-0108-4ffb-9191-59d727181559 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:52.247200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7833cd87-0108-4ffb-9191-59d727181559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:52.294681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98299c0-d5f2-4845-bd0e-cf84f2b251c9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:52.299709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:52.323558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 309/604] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:52.333931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.334851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.335123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.335499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/34e1bd13b2094b93b41f10f209660b5c/roles/4ffa6416473b43719c4b6241a1af7b13` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.336325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833cd87-0108-4ffb-9191-59d727181559 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.339144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:52.359118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=34e1bd13b2094b93b41f10f209660b5c, role_id=4ffa6416473b43719c4b6241a1af7b13)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:52.360592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.374622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 296/605] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:52 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/34e1bd13b2094b93b41f10f209660b5c/roles/4ffa6416473b43719c4b6241a1af7b13 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:52.376212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.489961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833cd87-0108-4ffb-9191-59d727181559 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:52.505610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aa28e-c95d-4261-bbbb-aa9026a33194 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:52.542863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.543744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.544031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.544315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.554547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:52.555131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.555991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.557098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.557387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.557667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/4d8bee133d6a4583a31c87aa4d4af927/roles/4ffa6416473b43719c4b6241a1af7b13` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:52.572991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:52.573947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:52.574843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 310/606] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:52.575801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.579606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=4d8bee133d6a4583a31c87aa4d4af927, role_id=4ffa6416473b43719c4b6241a1af7b13)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:52.579606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.601177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 297/607] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:52 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/4d8bee133d6a4583a31c87aa4d4af927/roles/4ffa6416473b43719c4b6241a1af7b13 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:52.602124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.639010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:52.739993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:52.759705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b290053-2172-44ea-99e6-eea533b58293 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:52.781635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fa951-966a-46ef-8047-93ea1bbcc4c8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:52.819695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.821712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.822071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.822626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.823433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:52.824055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:52.825937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:52.844540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 298/608] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:52.848238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:52.849059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:52.849341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:52.849665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:52.850496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.861452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:52.871514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:52.872520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:52.873471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 311/609] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:52.880162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:52.998107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc52b48-b4f7-4bff-bb62-c0cfdedcf179 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:53.011512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:53.045539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:53.055149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1c63-cebb-46ce-84ea-b2425ed434c4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:53.057504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:53.059317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:53.059610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:53.059888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:53.060643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:53.060946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:53.062328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:53.077851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 312/610] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:56:53.080045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:53.161213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:53.162126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:53.162412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:53.162692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/a5b5399fad924cabaf1d414bbca2c191/roles/4ffa6416473b43719c4b6241a1af7b13` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:53.195615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f8f4-6adc-4c06-a472-2b737c7aadcf None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:53.204507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=a5b5399fad924cabaf1d414bbca2c191, role_id=4ffa6416473b43719c4b6241a1af7b13)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:53.205978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:53.239752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 299/611] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:52 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/a5b5399fad924cabaf1d414bbca2c191/roles/4ffa6416473b43719c4b6241a1af7b13 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:53.244551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:53.245483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:53.245825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:53.246106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:53.264331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:53.265838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:53.292741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:53.293749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:53.294688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:53.294688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:53.294688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:53.294688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:53.296800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 313/612] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:53.303835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:53.453354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31506dd-45cb-4156-bff3-155913c1d359 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:53.496365 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:53.497038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:53.497321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:53.497596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:53.498330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:53.498645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:53.500050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:53.513923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 300/613] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:53.520203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:53.545492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:53.637578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fdae7-3ce2-44f1-b71c-5192042d1832 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:53.675713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7445dd-d481-409b-b459-9a10d1c84cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:53.676524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7445dd-d481-409b-b459-9a10d1c84cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:53.676807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7445dd-d481-409b-b459-9a10d1c84cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:53.677079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7445dd-d481-409b-b459-9a10d1c84cc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:53.685387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7445dd-d481-409b-b459-9a10d1c84cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:53.686913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7445dd-d481-409b-b459-9a10d1c84cc7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-4e7445dd-d481-409b-b459-9a10d1c84cc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:53.701898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:53.702899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:53.703977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 314/614] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:53.712847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:53.724499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:53.731051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec886a-fd7e-40ed-a0c1-c55594d5be6c None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:53.731342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec886a-fd7e-40ed-a0c1-c55594d5be6c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:53.731643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec886a-fd7e-40ed-a0c1-c55594d5be6c None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:53.733325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 315/615] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:53.742775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a78f-9cc3-4f57-8e5b-88b346b32e92 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:53.743060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a78f-9cc3-4f57-8e5b-88b346b32e92 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:53.743340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a78f-9cc3-4f57-8e5b-88b346b32e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:53.770699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5fc3a78f-9cc3-4f57-8e5b-88b346b32e92 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:53.771977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5fc3a78f-9cc3-4f57-8e5b-88b346b32e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:53.842301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 316/616] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:56:53.890300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a78f-9cc3-4f57-8e5b-88b346b32e92 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:53.902392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:53.928037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f9e2-fa91-457f-bc51-c3fb57e67cde None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:53.999346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a78f-9cc3-4f57-8e5b-88b346b32e92 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:54.011932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.012625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.012914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.013195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.014053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:54.014365 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:54.019929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:54.044845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.045707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.045985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.046299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.053700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 301/617] 10.222.0.78 () {56 vars in 1135 bytes} [Mon Jul 4 09:56:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:54.064621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:54.065120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:54.073858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:54.074848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:54.075723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:54.078473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 317/618] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:54.084613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:54.174756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:54.224801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:54.262522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd670dde-307b-4ce3-a503-a4e36594eade None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:54.267941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54fe5b-408a-4e92-84dd-9d816003646f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:54.306526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.308763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.309051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.309332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.311605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:54.311909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:54.313297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:54.332251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 318/619] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:54.336594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:54.345855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.346664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.346977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.347255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.365927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:54.367392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:54.400855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:54.401962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:54.402865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:54.402865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:54.402865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:54.402865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:54.402865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 302/620] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:56:54.408453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:54.526780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520734b-cd8d-486b-b8c0-f72092d10edf None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:54.584694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:54.593199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.595196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.595513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.596651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.601773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa0af-7dea-4bd0-9d2d-4612bcdcd9c0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:54.620991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:54.622475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:54.634765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:54.651354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:54.652360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:54.653273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:54.653273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:54.653273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:54.653273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:54.653273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 319/621] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:54.660937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:54.661774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44fb9-4471-44d5-9f53-b6b5d18ff905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.662462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44fb9-4471-44d5-9f53-b6b5d18ff905 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.662800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44fb9-4471-44d5-9f53-b6b5d18ff905 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.663087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44fb9-4471-44d5-9f53-b6b5d18ff905 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.663900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f44fb9-4471-44d5-9f53-b6b5d18ff905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:54.664213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f44fb9-4471-44d5-9f53-b6b5d18ff905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:54.665689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f44fb9-4471-44d5-9f53-b6b5d18ff905 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:54.687116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 303/622] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:54.688608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5d1b-43b9-4906-b86c-0af746bebbc4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.688901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5d1b-43b9-4906-b86c-0af746bebbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.689178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5d1b-43b9-4906-b86c-0af746bebbc4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.690678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 304/623] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:54.693241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5d1b-43b9-4906-b86c-0af746bebbc4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:54.806459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5d1b-43b9-4906-b86c-0af746bebbc4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:54.810961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee949046-fc60-4bbe-a3fa-cfb612c25d12 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:54.848017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a976e53-ddf2-40ca-9353-4b4b5d0ee53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.848699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a976e53-ddf2-40ca-9353-4b4b5d0ee53f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.848966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a976e53-ddf2-40ca-9353-4b4b5d0ee53f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.849239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a976e53-ddf2-40ca-9353-4b4b5d0ee53f None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.850330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a976e53-ddf2-40ca-9353-4b4b5d0ee53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:54.850440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a976e53-ddf2-40ca-9353-4b4b5d0ee53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:54.852826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a976e53-ddf2-40ca-9353-4b4b5d0ee53f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:54.856467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:54.858479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.859190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.859825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.869591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:54.871369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:54.873655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 320/624] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:54.875145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0b61-bd7e-493f-988c-21256e6b612d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:54.875447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0b61-bd7e-493f-988c-21256e6b612d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:54.875748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0b61-bd7e-493f-988c-21256e6b612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:54.892174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:54.893157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:54.894823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:54.895279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f40b0b61-bd7e-493f-988c-21256e6b612d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:54.896271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f40b0b61-bd7e-493f-988c-21256e6b612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:54.902463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 305/625] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:54.902463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:54.946224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:54.952540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:54.988026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 321/626] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:54.988026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b0b61-bd7e-493f-988c-21256e6b612d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.048194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0dfe-7fe4-4092-9a55-25284d839603 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.089506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.090761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.090761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.091208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.100252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:55.101928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:55.117789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:55.118802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:55.119800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 306/627] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:55.122072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b0b61-bd7e-493f-988c-21256e6b612d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.124368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.163664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.164027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.164309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.164586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.165379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:55.165694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:55.167127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:55.183604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 322/628] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:55.183604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.220845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:55.229417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:55.235714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a987fbb-845f-4c55-b42e-c68ba69d5466 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.272920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d966c-add7-4c09-aaa1-be773566342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.273722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d966c-add7-4c09-aaa1-be773566342e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.274011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d966c-add7-4c09-aaa1-be773566342e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.274292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d966c-add7-4c09-aaa1-be773566342e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.286157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d966c-add7-4c09-aaa1-be773566342e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b31d966c-add7-4c09-aaa1-be773566342e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:55.294029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:55.294971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:55.301893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:55.302944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b551ec9-eb09-4790-89ea-fb9112535560 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.303064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 307/629] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:55.303064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e9e4-5575-4b11-b7cf-fb36fa9fdb27 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.303064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e9e4-5575-4b11-b7cf-fb36fa9fdb27 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.303064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e9e4-5575-4b11-b7cf-fb36fa9fdb27 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.303903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 308/630] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:55.304703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915e9e4-5575-4b11-b7cf-fb36fa9fdb27 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.341346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.341940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.342227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.342506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.343357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:55.343703 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:55.345138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:55.366505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 323/631] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:56:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:55.367629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.421041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915e9e4-5575-4b11-b7cf-fb36fa9fdb27 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.457907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6776-f4bf-4467-b241-6943c50c099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.459128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6776-f4bf-4467-b241-6943c50c099a None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.459410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6776-f4bf-4467-b241-6943c50c099a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.459787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6776-f4bf-4467-b241-6943c50c099a None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/323dac67dfab4c95b3c1d6ccc9b0a701/roles/4ffa6416473b43719c4b6241a1af7b13` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.475303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d6776-f4bf-4467-b241-6943c50c099a None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=323dac67dfab4c95b3c1d6ccc9b0a701, role_id=4ffa6416473b43719c4b6241a1af7b13)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:55.476256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:55.476811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d6776-f4bf-4467-b241-6943c50c099a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:55.486177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e3b2a-048b-4089-aa98-32f762c51fe2 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.489786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 309/632] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:56:55 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/323dac67dfab4c95b3c1d6ccc9b0a701/roles/4ffa6416473b43719c4b6241a1af7b13 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:56:55.491322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b214-a369-4cac-b759-2f0e641aabd3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.491843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b214-a369-4cac-b759-2f0e641aabd3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.492307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b214-a369-4cac-b759-2f0e641aabd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.505695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:55.512753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b331b214-a369-4cac-b759-2f0e641aabd3 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:55.514637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b331b214-a369-4cac-b759-2f0e641aabd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:55.538399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.539201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.539560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.539923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.540799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:55.541195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:55.543438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:55.563763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 324/633] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:55.565054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.619685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 310/634] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:55.619685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b214-a369-4cac-b759-2f0e641aabd3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.722413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8246-5f45-40b6-b222-7ca6e67e3ee5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.738713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b214-a369-4cac-b759-2f0e641aabd3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.761173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae9cc-bd55-4a99-af6d-da506976c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.761832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae9cc-bd55-4a99-af6d-da506976c9fc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.762118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae9cc-bd55-4a99-af6d-da506976c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.762397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae9cc-bd55-4a99-af6d-da506976c9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.778889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.779721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.780005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.780283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.783076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:55.790183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:55.792050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:55.793635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:55.811682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:55.812683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:55.813639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:55.813639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:55.813639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:55.813639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:55.813639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 311/635] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:55.813943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.841325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eae9cc-bd55-4a99-af6d-da506976c9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:55.842785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eae9cc-bd55-4a99-af6d-da506976c9fc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:55.943101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fd19-c6b4-42e0-8348-60b2a3f38652 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:55.946282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 325/636] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:55.947626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c1ad-d10d-4a02-a949-060ab009d9b7 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.947916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c1ad-d10d-4a02-a949-060ab009d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.948186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c1ad-d10d-4a02-a949-060ab009d9b7 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.953467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 326/637] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:55.954225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c1ad-d10d-4a02-a949-060ab009d9b7 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:55.980498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:55.981300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:55.981587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:55.981870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:55.993036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:56.000855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:56.002026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:56.002946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 312/638] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:56.004281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.023873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.064327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.074186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c1ad-d10d-4a02-a949-060ab009d9b7 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.107458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873ab0-0f97-42bc-aacc-c6a2bea45e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.108145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873ab0-0f97-42bc-aacc-c6a2bea45e00 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.108425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873ab0-0f97-42bc-aacc-c6a2bea45e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.108697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873ab0-0f97-42bc-aacc-c6a2bea45e00 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.109419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873ab0-0f97-42bc-aacc-c6a2bea45e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:56.109721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873ab0-0f97-42bc-aacc-c6a2bea45e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.111077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873ab0-0f97-42bc-aacc-c6a2bea45e00 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.123875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bdf93-2620-4434-a158-e3b2cca94b8d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.129376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 327/639] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:56.129376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7edaf7-680b-4a05-98f0-953429541c03 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.129376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7edaf7-680b-4a05-98f0-953429541c03 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.129376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7edaf7-680b-4a05-98f0-953429541c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.142978 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-dc7edaf7-680b-4a05-98f0-953429541c03 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:56.144857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-dc7edaf7-680b-4a05-98f0-953429541c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:56.168857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.169706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.169992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.170270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.183331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.184836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:56.203132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:56.204093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:56.205018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:56.205018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:56.205018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:56.205018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:56.205018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 313/640] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:56.205018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.215550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 328/641] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:56.216492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7edaf7-680b-4a05-98f0-953429541c03 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.273651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.313009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.317228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fbcc9-9071-44c8-a16c-f5a11d38e10f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.337490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7edaf7-680b-4a05-98f0-953429541c03 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.353360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.354029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.354313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.354582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.355329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:56.355670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.357027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.368600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 314/642] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:56.369270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.380469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.381388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.381675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.381953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.389921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.391498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:56.408396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:56.409596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 329/643] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:56.410598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.477949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c004fe2-5844-47f8-8a32-06ad23c3e969 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.511755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.512411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.512690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.512968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.513692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:56.513997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.515351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.520160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcbec5-181d-4212-a050-a2b6427ec5ac None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.523037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.534587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 315/644] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:56.535467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.559956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.560932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.561544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.561843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.563699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.580908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:56.589457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:56.590413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 330/645] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:56.597695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.648039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658246d-29d1-4edf-8697-35e8a89c7ee0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.685898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.686770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.687063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.687341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.698924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.700414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.715672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518d861-cb80-4ca0-926c-6cc239fc6378 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:56.719511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:56.720608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:56.721557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:56.721557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:56.721557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:56.721557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:56.721557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 316/646] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:56.721996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.762024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.762610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.762895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.763169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.764063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:56.764377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.766279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.788964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 331/647] 10.222.0.78 () {56 vars in 1137 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:56.788964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.805993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.813810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:56.833746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623380f-b875-4708-9494-5b64dac3f946 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.869934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.870735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.871019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.871293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.878712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.881286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.890910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15282ca1-4226-442a-9b83-ef48715d0c97 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:56.897551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:56.898495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:56.899393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 317/648] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:56.900402 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:56.931314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:56.932035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:56.932318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:56.932597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:56.933345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:56.933652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:56.935020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:56.944002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 332/649] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:56.944860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.014449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a84b5-1c2a-488f-89d3-e80cad1aba55 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.037014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.053082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.053765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.054052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.054335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.054958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c37985-0e2c-4f76-b11e-b4793999b83a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.055653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:57.056219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.058400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.059657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.076903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 318/650] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:57.078056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.109026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.109685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.109970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.110252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.183059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.184977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.191857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38468-c6aa-43df-8339-01a872e8b923 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.226488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.227411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.227731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.228013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.228817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:57.229136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.230580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.243880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 319/651] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:57.244618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.286136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.304444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.308065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 333/652] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:57.309171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.358270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c4653-f756-4e6f-9b8b-65e16c9f9cde None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.399916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.400707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.400994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.401275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.412004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.413469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.415809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a9bc-60d6-43da-8315-8770f2be7a32 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:57.431783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:57.432742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:57.433812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:57.433812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:57.433812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:57.433812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:57.433812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 320/653] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:57.433812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.462443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.463360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.463676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.464007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.472564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.474072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:57.490999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:57.492249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:57.493247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 334/654] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:57.493865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.545272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.556375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b992-bb83-441f-bcef-473329ec87f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.564224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.596029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.597309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.597601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.597876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.598719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3a63afc7b9514ef7b4d799b1c1538b36) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:57.599032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.600494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.615618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 321/655] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/role_assignments?user.id=3a63afc7b9514ef7b4d799b1c1538b36&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:57.615618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.628484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a62ae-933b-46f3-bada-f63d9d7b322e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.667507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.668373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.668659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.668936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.681096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.682595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:57.702076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:57.703237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:57.704235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:57.704235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:57.704235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:57.704235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:57.704235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 335/656] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:57.704235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.738987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cef95d-5aec-451f-a110-674fbd198269 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.781151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a96793-ac3f-4cce-a412-5caee2069576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.781832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a96793-ac3f-4cce-a412-5caee2069576 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.782538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a96793-ac3f-4cce-a412-5caee2069576 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.782538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a96793-ac3f-4cce-a412-5caee2069576 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.783500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a96793-ac3f-4cce-a412-5caee2069576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:57.783500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a96793-ac3f-4cce-a412-5caee2069576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.785635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a96793-ac3f-4cce-a412-5caee2069576 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.802042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 322/657] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:57.802042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43386de1-5fdd-4ad4-9575-38742633ae7b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.802042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43386de1-5fdd-4ad4-9575-38742633ae7b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.802042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43386de1-5fdd-4ad4-9575-38742633ae7b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.802042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 323/658] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:57.802948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43386de1-5fdd-4ad4-9575-38742633ae7b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.820792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.828078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae5f7-3d3f-44a1-85b3-5b19b4e3a5ab None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.842472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:57.869593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.870281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.870568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.870849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.871749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:57.872068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.873510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.891766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 336/659] 10.222.0.78 () {56 vars in 1137 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:57.892456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:57.924570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43386de1-5fdd-4ad4-9575-38742633ae7b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:57.962243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9f0c0-dc11-4229-bb88-7fc2552a1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:57.962920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f0c0-dc11-4229-bb88-7fc2552a1b72 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.963224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f0c0-dc11-4229-bb88-7fc2552a1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.963481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f0c0-dc11-4229-bb88-7fc2552a1b72 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:57.964252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9f0c0-dc11-4229-bb88-7fc2552a1b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:57.964564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9f0c0-dc11-4229-bb88-7fc2552a1b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:57.965921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9f0c0-dc11-4229-bb88-7fc2552a1b72 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:57.984754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 324/660] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:57.984754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67960a-4fab-4d2e-bb27-5f3f9af9b15d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:57.984754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67960a-4fab-4d2e-bb27-5f3f9af9b15d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:57.984754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67960a-4fab-4d2e-bb27-5f3f9af9b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.000937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1a67960a-4fab-4d2e-bb27-5f3f9af9b15d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:56:58.002174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1a67960a-4fab-4d2e-bb27-5f3f9af9b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:56:58.005544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dceb0-f20f-445c-adc7-ca2854de6a03 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.040618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.041422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.041709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.041987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.050324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.051830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:58.068377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:58.069328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 09:56:58.070287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:58.074212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 337/661] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:58.075066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.079771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 325/662] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:56:58.079771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67960a-4fab-4d2e-bb27-5f3f9af9b15d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.093647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.113261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.189856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1928913-2a39-4b6d-9ad6-ac682c6d87d0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.203350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67960a-4fab-4d2e-bb27-5f3f9af9b15d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.224764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.225425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.225710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.225987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.241413 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.242334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.242621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.242903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.250733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.252345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:58.268234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:58.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:58.270236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 326/663] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:58.270725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.301054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.302771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.318739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.371364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.393652 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01708b6d-496d-452d-b385-60c596c3f02f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.416710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 338/664] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:58.416710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.434245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.439627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.439998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.440814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.441686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:58.442004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.443467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.466055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 327/665] 10.222.0.78 () {56 vars in 1139 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:58.466055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.532426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d2c06-1830-43a8-81c9-4d287ad72ec1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.547381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.579210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.579492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e10cb-1f87-4641-957a-7b51724b9ea8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.580044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.580326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.580600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.593059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:56:58.601619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:58.602744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:58.603979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 339/666] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:58.604843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.620607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.621272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.621556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.621836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.622632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:58.622941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.624394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.631163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.641901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 328/667] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:58.641901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.718057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb35a0-bda4-465d-b1f4-b532c97b3fc5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.749789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47165743-9445-4351-b271-e79e07bc39d7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.751965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.753422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.753744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.754017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.771620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.771620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:58.785436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:58.786559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:58.792076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:58.792076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:58.792076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:58.792076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:58.792076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 340/668] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:58.792076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.797915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79239676-d57c-4949-a285-210e04102e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.798602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79239676-d57c-4949-a285-210e04102e51 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.798889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79239676-d57c-4949-a285-210e04102e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.799168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79239676-d57c-4949-a285-210e04102e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.830266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.876428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:58.880814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79239676-d57c-4949-a285-210e04102e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.882840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79239676-d57c-4949-a285-210e04102e51 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.916435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f7f68-5ea5-4b46-8569-ab92b9e1b7d9 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:58.957700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:58.958374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:58.958715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:58.958998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:58.959790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:58.960098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:58.961740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:58.970813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 341/669] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:58.971727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:58.996841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 329/670] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:56:58.997937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79239676-d57c-4949-a285-210e04102e51 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.068421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.081370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8015e68-d176-4e0c-b34a-73522b4aad1b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.099974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.104064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79239676-d57c-4949-a285-210e04102e51 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.121680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.122629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.122924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.123202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.124083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=34e1bd13b2094b93b41f10f209660b5c) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:59.124400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.126254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.135725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 342/671] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/role_assignments?user.id=34e1bd13b2094b93b41f10f209660b5c&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:59.136551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.152952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.154151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.154437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.154713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.155474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:59.155815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.157223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.178773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 330/672] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:59.180188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.259354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b200e-f974-47f6-8d35-a7c2b175fd85 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.299155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.300472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90b8bd-d030-4f21-9eec-9f99db7cbde9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.300608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.300820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.301090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.312717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.314181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:59.338600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:59.339526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:59.340599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:59.340599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:59.340599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:59.340599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:59.340599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 343/673] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:59.341412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.345824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.350624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.351445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.352323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.352592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.364943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.366409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:56:59.385931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:59.386879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:59.387839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:56:59.387839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:56:59.387839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:56:59.387839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:59.394765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 331/674] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:59.395906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.410675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.483431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3b25e-4204-4f29-9f17-cd4d5ca74078 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.518327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497afbff-eb68-41ce-8957-a986f84b910c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.532906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.535342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.535872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.536618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.546654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.549095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.556204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.556876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.557159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.557437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.558172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:59.558480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.561965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:59.573838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:59.574991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:59.576126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:59.583407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 344/675] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:59.583407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.585860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 332/676] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:59.586372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.652510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.688125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.694815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b608e10-fec3-43a3-bb6d-891a0b11d40a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.731677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.732340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.732627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.732983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.733637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:59.733999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.735439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.735749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c555fc-b5ef-4e46-be93-8324c28612e8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.748631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 345/677] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:59.749571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.779326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.780213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.780497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.780770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.781563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:56:59.781872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.783390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.796775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 333/678] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:56:59.797900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.865697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e19dc-6a2c-4553-ac14-59f73a399a47 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.890029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.903331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f5e6f-2371-48d1-b0fb-43edd8e6e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.904251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f5e6f-2371-48d1-b0fb-43edd8e6e660 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.904535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f5e6f-2371-48d1-b0fb-43edd8e6e660 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.904930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f5e6f-2371-48d1-b0fb-43edd8e6e660 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.908324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf43fc-9f85-4870-af94-17a6e7cdda19 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:56:59.913560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f5e6f-2371-48d1-b0fb-43edd8e6e660 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.915028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f5e6f-2371-48d1-b0fb-43edd8e6e660 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-521f5e6f-2371-48d1-b0fb-43edd8e6e660 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:56:59.930248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:59.931254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 346/679] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:59.932894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f97db-5f7b-495a-bc6a-3c3c8613147a None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.933586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f97db-5f7b-495a-bc6a-3c3c8613147a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.933586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f97db-5f7b-495a-bc6a-3c3c8613147a None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.938512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 347/680] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:56:59.938512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f97db-5f7b-495a-bc6a-3c3c8613147a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:56:59.946796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:56:59.954197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:56:59.955039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:56:59.955304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:56:59.955568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:56:59.963559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:56:59.965132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:56:59.981044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:56:59.981962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:56:59.982864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 334/681] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:56:59.983474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.056825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f97db-5f7b-495a-bc6a-3c3c8613147a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:00.092426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ad54d-9706-4e06-9f82-66b143fdb417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:00.093082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ad54d-9706-4e06-9f82-66b143fdb417 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.093371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ad54d-9706-4e06-9f82-66b143fdb417 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.093912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ad54d-9706-4e06-9f82-66b143fdb417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.094560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ad54d-9706-4e06-9f82-66b143fdb417 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=4d8bee133d6a4583a31c87aa4d4af927) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:00.094793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ad54d-9706-4e06-9f82-66b143fdb417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:00.096325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ad54d-9706-4e06-9f82-66b143fdb417 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:00.100705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48b3a2-0a58-4699-8a52-2db027811f4b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:00.103197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 348/682] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/role_assignments?user.id=4d8bee133d6a4583a31c87aa4d4af927&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:00.104649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c69dc-ba8b-42f5-bd38-488db1edb855 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.105116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c69dc-ba8b-42f5-bd38-488db1edb855 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.105547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c69dc-ba8b-42f5-bd38-488db1edb855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.124627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-307c69dc-ba8b-42f5-bd38-488db1edb855 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:00.126296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-307c69dc-ba8b-42f5-bd38-488db1edb855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:00.160560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:00.162017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.162383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.162734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.164049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:00.164451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:00.166366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:00.194137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:00.203643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 335/683] 10.222.0.78 () {56 vars in 1135 bytes} [Mon Jul 4 09:56:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:00.203643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.248972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 349/684] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:57:00.250955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c69dc-ba8b-42f5-bd38-488db1edb855 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.305735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:00.374144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ab9b5-35d8-4e1b-8f3c-58d7e540004c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:00.397674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c69dc-ba8b-42f5-bd38-488db1edb855 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:00.414856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:00.415449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.415812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.416038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.417027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:00.417348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:00.418917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:00.441185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 336/685] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:00.441382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.445373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:00.446329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.446788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.447234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.502355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:00.528551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:00.530120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:00.561906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b98f2-85bd-4d86-af8b-173063284dcb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:00.572790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:00.601347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:00.602154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.602500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.602760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.614293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:00.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:00.623560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:00.624436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:00.629240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 337/686] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:00.630172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.653230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 350/687] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:57:00.654381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.754625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b46078-86b4-495a-bf5e-2fd426fa955e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:00.761376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8044c-fe34-438b-aac3-70bee01e6513 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:00.789889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:00.799202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:00.799919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.800205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.800484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.801323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=a5b5399fad924cabaf1d414bbca2c191) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:00.801649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:00.803072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:00.803343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:00.804445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:00.804934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:00.805481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:00.806519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:00.807032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:00.808712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:00.811725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 338/688] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:00 2022] GET /identity/v3/role_assignments?user.id=a5b5399fad924cabaf1d414bbca2c191&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:00.812772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.833848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 351/689] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:00.839270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:00.898369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:01.034475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334b619-b884-4f78-81c3-923e29d1f96d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.037755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26c32-1754-47a5-9ab0-858fb570e53f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.084670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.086239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.086763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.087067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.087471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.087901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.088182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.088456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.098863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:01.102280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.104303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.106491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.108849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:01.125386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:01.126317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:01.127221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:01.127221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:01.127221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:01.127221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:01.127221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 352/690] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:01.132232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:01.133227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:01.134124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:01.134124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:01.134124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:01.134124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:01.136243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 339/691] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:01.140563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.141597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.258155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:01.277379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877754d-1d0c-49f0-8515-cae90a60f570 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.300064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ea272-ea3b-485e-beec-bc5c8b1149a1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.339619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd1144-7b29-4ce8-b6a0-6a923f3a53be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.340303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd1144-7b29-4ce8-b6a0-6a923f3a53be None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.340588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd1144-7b29-4ce8-b6a0-6a923f3a53be None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.340863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd1144-7b29-4ce8-b6a0-6a923f3a53be None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.341609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd1144-7b29-4ce8-b6a0-6a923f3a53be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:01.341919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd1144-7b29-4ce8-b6a0-6a923f3a53be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.343306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd1144-7b29-4ce8-b6a0-6a923f3a53be None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.359824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.360144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 340/692] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:01.361468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451f219-ca4a-4634-852f-71d5eecb2969 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.361755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451f219-ca4a-4634-852f-71d5eecb2969 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.362089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451f219-ca4a-4634-852f-71d5eecb2969 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.364063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.364351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.364695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.365447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:01.365761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.367557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 341/693] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:01.368579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.368830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915895-777c-4654-acbd-7bc26b4aff56 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.369120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915895-777c-4654-acbd-7bc26b4aff56 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.369396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915895-777c-4654-acbd-7bc26b4aff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.385976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 353/694] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:01.386882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-84915895-777c-4654-acbd-7bc26b4aff56 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:01.387729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.388514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-84915895-777c-4654-acbd-7bc26b4aff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:01.448787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:01.468264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 342/695] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:57:01.469443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84915895-777c-4654-acbd-7bc26b4aff56 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.512697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec6c0-58e1-4a9e-a20c-b7afbd1aa955 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.549748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.550655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.550886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.551161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.554715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:01.558884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.560502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:01.585517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:01.586444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:01.587357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:01.591647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 354/696] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:01.592671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.596391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84915895-777c-4654-acbd-7bc26b4aff56 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.634450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.635620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.636227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.636814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.645730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.647533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:01.663151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:01.664187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:01.665174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:01.672216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 343/697] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:01.673276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.718988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47caebf-2dc8-4e58-9027-93800f65eee5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.736909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:01.766937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.767892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.768211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.769034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.785713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.788047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.793387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f6cc4-bd3d-416c-86ff-362a874a5ac5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:01.812687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:01.813623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:01.814549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:01.814549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:01.814549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:01.814549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:01.819614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 355/698] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:01.820641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.844534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.845214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.845502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.845782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.847209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:01.847524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.849579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:01.851747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:01.874267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 344/699] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:01.875197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:01.952385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac748ec0-df0f-4016-9332-4ba5d6ffbade None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:01.995534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:01.996416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:01.996530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:01.996806 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:01.997683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:01.997961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:01.999484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:02.008837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47854-cd65-47e4-9f67-7bca179ca6e4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:02.022714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 356/700] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:02.022714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:02.046161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:02.066997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:02.068085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.069165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.069672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.071131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:02.071686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:02.074035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:02.095749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 345/701] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:02.095749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:02.154056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b864c-d9ac-44ed-a71f-4b6cf7ab3f64 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:02.161100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:02.206937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:02.208312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.208825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.209564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.211203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=323dac67dfab4c95b3c1d6ccc9b0a701) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:02.212944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:02.215018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:02.221079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac519-77d9-47c4-ae9a-af78beee1e32 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:02.224871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 357/702] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:02 2022] GET /identity/v3/role_assignments?user.id=323dac67dfab4c95b3c1d6ccc9b0a701&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:02.226065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:02.348417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:02.349073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.349360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.349680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.374447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:02.395200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cdf1c-bb36-4f34-b9be-bd1304cee85a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:02.485992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460b0c-9571-47d9-8a2f-6bc7056eb2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:02.487734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460b0c-9571-47d9-8a2f-6bc7056eb2aa None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.488264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460b0c-9571-47d9-8a2f-6bc7056eb2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.488790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460b0c-9571-47d9-8a2f-6bc7056eb2aa None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.490357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460b0c-9571-47d9-8a2f-6bc7056eb2aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:02.492277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460b0c-9571-47d9-8a2f-6bc7056eb2aa None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:02.503546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:02.505108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:02.517152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 358/703] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:57:02 2022] POST /identity/v3/users => generated 254 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:02.523707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41d791-6ed1-49a7-a68f-501574d7714e None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.525739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41d791-6ed1-49a7-a68f-501574d7714e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.525739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41d791-6ed1-49a7-a68f-501574d7714e None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.527022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 359/704] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:02.533303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a54384-32df-4105-b80a-7ddf42fc1afa None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.534540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a54384-32df-4105-b80a-7ddf42fc1afa None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.535187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a54384-32df-4105-b80a-7ddf42fc1afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.581389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-17a54384-32df-4105-b80a-7ddf42fc1afa None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:02.582621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-17a54384-32df-4105-b80a-7ddf42fc1afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:02.585795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:02.707513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 360/705] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:57:02.732706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a54384-32df-4105-b80a-7ddf42fc1afa None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:02.743460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 346/706] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:57:02.751172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:02.842323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:02.884548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a54384-32df-4105-b80a-7ddf42fc1afa None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:02.923756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca340e6-d234-45e1-aae4-a951ccdddfa1 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:02.925095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:02.926382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.926865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.927630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.928512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:02.930099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:02.945991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:02.947044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:02.947914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:02.950914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 361/707] 10.222.0.78 () {56 vars in 1129 bytes} [Mon Jul 4 09:57:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:02.957362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:02.961737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:02.962938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:02.962938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:02.963128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:02.975354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:02.977150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:02.996952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:02.997912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:02.998809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:02.998809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:02.998809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:02.998809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:02.998809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 347/708] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:03.004702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.013723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:03.072968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d189af-078e-4da8-8645-2c1f2aeead58 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.108454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.109215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.109499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.109774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.110487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:03.110793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.112776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.114799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:03.118975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 362/709] 10.222.0.78 () {56 vars in 1124 bytes} [Mon Jul 4 09:57:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:03.123586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.128785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c9f3-3d6f-4784-a2d6-1022259b28da None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.192631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.193761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.194274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.194757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.195754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:03.196328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.198016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.221386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 348/710] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:03.226998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.227727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5e8ec-06a6-4b92-94e7-c0739e943fd3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.288362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc08921-8417-4bdd-9a49-fa627aaf3295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.289034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc08921-8417-4bdd-9a49-fa627aaf3295 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.289313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc08921-8417-4bdd-9a49-fa627aaf3295 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.289584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc08921-8417-4bdd-9a49-fa627aaf3295 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.290295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc08921-8417-4bdd-9a49-fa627aaf3295 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:03.290599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc08921-8417-4bdd-9a49-fa627aaf3295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.291993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc08921-8417-4bdd-9a49-fa627aaf3295 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.306810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 363/711] 10.222.0.78 () {56 vars in 1124 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:03.319593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5106-863c-4a8f-8f0b-9cd5c32b7d41 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.319947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5106-863c-4a8f-8f0b-9cd5c32b7d41 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.320207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5106-863c-4a8f-8f0b-9cd5c32b7d41 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.321637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 364/712] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:03.327396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920b73-feb5-4207-b587-105f40e63bb1 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.327755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920b73-feb5-4207-b587-105f40e63bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.327992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920b73-feb5-4207-b587-105f40e63bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.357808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e1920b73-feb5-4207-b587-105f40e63bb1 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:03.359071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e1920b73-feb5-4207-b587-105f40e63bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:03.382904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:03.456807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c86c-aa4c-4923-9886-58f62be0b274 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.461167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:03.462742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 365/713] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:57:03.486426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1920b73-feb5-4207-b587-105f40e63bb1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.501489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.502308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.503156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.503435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.510806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.512307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:03.527269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:03.528238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:03.529247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 349/714] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:03.535443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.617360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1920b73-feb5-4207-b587-105f40e63bb1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.652039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f61d78-bc5a-47a0-a31c-8f3c10da0d01 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.673637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.675039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.675316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.675604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.676286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.677920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.682110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:03.702785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.703501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.703833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.704116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.704923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:03.705296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.707345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:03.708120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:03.709113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:03.710406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:03.711160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 366/715] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:03.716366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.735740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 350/716] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:03.744536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.799173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:03.841937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84920b-3adb-4c91-a81e-b4ab3b8c02e3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.875600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.876348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.876538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.876810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.878077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] RBAC: Adding query filter params (name=network) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:03.878378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.879774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.884345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 367/717] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:03.892570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:03.911971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec57a6-90db-4068-b90d-e315f59f4e29 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:03.950592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3211f10-2618-4bf7-9a6d-a40784170ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:03.951329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3211f10-2618-4bf7-9a6d-a40784170ecb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:03.955612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3211f10-2618-4bf7-9a6d-a40784170ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:03.955612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3211f10-2618-4bf7-9a6d-a40784170ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:03.955612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3211f10-2618-4bf7-9a6d-a40784170ecb None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3a63afc7b9514ef7b4d799b1c1538b36) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:03.955612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3211f10-2618-4bf7-9a6d-a40784170ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:03.955612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3211f10-2618-4bf7-9a6d-a40784170ecb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:03.969906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 351/718] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/role_assignments?user.id=3a63afc7b9514ef7b4d799b1c1538b36&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:04.058032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1232591-0844-473f-951b-c89e7b0f5aee None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:04.088105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:04.099812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8def0a-e438-43bb-b93d-27be080152bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:04.100769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8def0a-e438-43bb-b93d-27be080152bc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:04.101110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8def0a-e438-43bb-b93d-27be080152bc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:04.101471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8def0a-e438-43bb-b93d-27be080152bc None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:04.102342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8def0a-e438-43bb-b93d-27be080152bc None admin] RBAC: Adding query filter params (type=network) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:04.102650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8def0a-e438-43bb-b93d-27be080152bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:04.104071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8def0a-e438-43bb-b93d-27be080152bc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:04.109689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 368/719] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:05.061728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb343a-59b0-44ec-8441-7c66224359db None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.062259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb343a-59b0-44ec-8441-7c66224359db None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.062259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb343a-59b0-44ec-8441-7c66224359db None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.063958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 352/720] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:05.069542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc24e7d-f11e-4f2c-81ff-cfc647a15072 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.069958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc24e7d-f11e-4f2c-81ff-cfc647a15072 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.070145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc24e7d-f11e-4f2c-81ff-cfc647a15072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.093618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ddc24e7d-f11e-4f2c-81ff-cfc647a15072 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:05.094803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ddc24e7d-f11e-4f2c-81ff-cfc647a15072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:05.164917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344a323-dee3-4883-b6ac-2740659f7648 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.165243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344a323-dee3-4883-b6ac-2740659f7648 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.165482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344a323-dee3-4883-b6ac-2740659f7648 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.168164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 353/721] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:05.172247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac5dd-b98b-4c82-86a3-a4435199b713 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.172544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac5dd-b98b-4c82-86a3-a4435199b713 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.172828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac5dd-b98b-4c82-86a3-a4435199b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.182014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 369/722] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:57:05.198081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fefac5dd-b98b-4c82-86a3-a4435199b713 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:05.199299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fefac5dd-b98b-4c82-86a3-a4435199b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:05.246771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc24e7d-f11e-4f2c-81ff-cfc647a15072 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:05.269430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:05.296997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 354/723] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 09:57:05.318531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac5dd-b98b-4c82-86a3-a4435199b713 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:05.425727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac5dd-b98b-4c82-86a3-a4435199b713 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:05.466205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:05.467037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.467439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.467758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.472603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc24e7d-f11e-4f2c-81ff-cfc647a15072 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:05.479790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:05.497283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:05.498543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:57:05.499651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:05.511716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 355/724] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:05.512445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:05.514151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:05.553652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:05.554700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.555135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.555561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.565670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:05.587520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:05.603836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:05.604861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:05.605842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 370/725] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:05.619482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:05.628127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247a1f-f6db-45fd-b83b-0755c51d9a65 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:05.663503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:05.664209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.664495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.664776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.665539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:05.665852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:05.667308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:05.680878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 356/726] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:05.682085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:05.776884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8739fe-891f-4d1a-b62b-6a3fbbe02413 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:05.817026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:05.818139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.818618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.820268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.821235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:05.823561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:05.825801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:05.848857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 371/727] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:05.855619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:05.869336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e7b1-1f45-4a6e-8c3c-790a1ae9cfe2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:05.871872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:05.930327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:05.946827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159616e2-e00f-4b7b-adc4-cc435608e7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:05.947938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159616e2-e00f-4b7b-adc4-cc435608e7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.948399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159616e2-e00f-4b7b-adc4-cc435608e7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.948820 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159616e2-e00f-4b7b-adc4-cc435608e7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:05.963311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159616e2-e00f-4b7b-adc4-cc435608e7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:05.965879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159616e2-e00f-4b7b-adc4-cc435608e7a5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-159616e2-e00f-4b7b-adc4-cc435608e7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:05.989695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:05.990863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:05.992035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:05.992035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:05.992035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:05.992035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:05.994739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 357/728] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:05.996870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009648-b29c-4be4-ac44-b23eaeb894a6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:05.997569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009648-b29c-4be4-ac44-b23eaeb894a6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:05.998017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009648-b29c-4be4-ac44-b23eaeb894a6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.000475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 358/729] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:06.001306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009648-b29c-4be4-ac44-b23eaeb894a6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.011124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b5657-679e-4441-a9e3-b2d0b5565940 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.046737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb146b02-a176-4d6a-a233-e7ca51f0ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.047838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb146b02-a176-4d6a-a233-e7ca51f0ca35 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.048264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb146b02-a176-4d6a-a233-e7ca51f0ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.048683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb146b02-a176-4d6a-a233-e7ca51f0ca35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.060219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb146b02-a176-4d6a-a233-e7ca51f0ca35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.061867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb146b02-a176-4d6a-a233-e7ca51f0ca35 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-bb146b02-a176-4d6a-a233-e7ca51f0ca35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:06.079854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:06.081999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:06.082905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:06.082905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:06.082905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:06.082905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:06.084713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 372/730] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:06.086057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70565eb-e472-4619-831f-cd6e827b84a4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.086577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70565eb-e472-4619-831f-cd6e827b84a4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.086994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70565eb-e472-4619-831f-cd6e827b84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.104674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a70565eb-e472-4619-831f-cd6e827b84a4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:06.106073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a70565eb-e472-4619-831f-cd6e827b84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:06.126282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009648-b29c-4be4-ac44-b23eaeb894a6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.167133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.167893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.168182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.168463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.169258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:06.169570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.171618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.185610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 373/731] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:57:06.186694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70565eb-e472-4619-831f-cd6e827b84a4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.194974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 359/732] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:06.200485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.222114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:06.229338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:06.324140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8640750-45ed-4adb-bd5d-5dce421f8058 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.336816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70565eb-e472-4619-831f-cd6e827b84a4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.363234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.364428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.364889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.365336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.374024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.375719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.380006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.380681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.380969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.381311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.382077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:06.382441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.384162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:06.393216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:06.394173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:06.395113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:06.396735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 374/733] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:06.397788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.398176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 360/734] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:06.404010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.491258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:06.507179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:06.515831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd58f-50a2-4625-a9d5-a1f30eb583fe None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.540222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177fe52-416d-44c1-ba39-5075ca97d3f3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.555124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.555941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.559173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.559447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.560219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.561630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.581700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1032907-266c-4229-bf33-de59537281d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.582503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1032907-266c-4229-bf33-de59537281d8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.591746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1032907-266c-4229-bf33-de59537281d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.591912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 375/735] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:06 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:06.592008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1032907-266c-4229-bf33-de59537281d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.592095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.603101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1032907-266c-4229-bf33-de59537281d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.604978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1032907-266c-4229-bf33-de59537281d8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a1032907-266c-4229-bf33-de59537281d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:06.622598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:06.623823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:06.624806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 361/736] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:06.628519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d4432-b680-4a11-b10b-59e518799ff3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.628519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d4432-b680-4a11-b10b-59e518799ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.628519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d4432-b680-4a11-b10b-59e518799ff3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.632470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 362/737] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:06.633641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d4432-b680-4a11-b10b-59e518799ff3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.728046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aaf45-988b-44bd-a55e-143bb7785988 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.764817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d4432-b680-4a11-b10b-59e518799ff3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.781716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d8f40-f290-469d-b5fd-4554293c0b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.782428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d8f40-f290-469d-b5fd-4554293c0b50 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.782714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d8f40-f290-469d-b5fd-4554293c0b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.783231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d8f40-f290-469d-b5fd-4554293c0b50 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.785146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d8f40-f290-469d-b5fd-4554293c0b50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:06.785146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d8f40-f290-469d-b5fd-4554293c0b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.786931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d8f40-f290-469d-b5fd-4554293c0b50 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.789676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:06.803677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.804360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.804643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.804919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.806241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:06.806241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:06.807511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:06.809965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 376/738] 10.222.0.78 () {56 vars in 1149 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:06.810314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:06.813209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c389f1-c7c2-4d07-9e77-301f44f60524 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.813495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c389f1-c7c2-4d07-9e77-301f44f60524 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.813772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c389f1-c7c2-4d07-9e77-301f44f60524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:06.829911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 363/739] 10.222.0.78 () {56 vars in 1135 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:06.830896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.838759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c2c389f1-c7c2-4d07-9e77-301f44f60524 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:06.840324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c2c389f1-c7c2-4d07-9e77-301f44f60524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:06.913594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 377/740] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:57:06.914366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c389f1-c7c2-4d07-9e77-301f44f60524 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:06.960955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2fdf7-1f91-4d13-8cd2-8e27ee6c196e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:06.996488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8b65a-a983-4617-b838-0a089dc9c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:06.997141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b65a-a983-4617-b838-0a089dc9c799 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:06.997436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b65a-a983-4617-b838-0a089dc9c799 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:06.997710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b65a-a983-4617-b838-0a089dc9c799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.030391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c389f1-c7c2-4d07-9e77-301f44f60524 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:07.057623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.065990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.070878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:07.071531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.071843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.072116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.077580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8b65a-a983-4617-b838-0a089dc9c799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:07.079142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8b65a-a983-4617-b838-0a089dc9c799 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:07.146743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:07.148242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:07.194033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 364/741] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:57:07.196137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857d2d0-b2e1-43fd-9dfb-1871e657ddd6 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.196429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857d2d0-b2e1-43fd-9dfb-1871e657ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.196713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857d2d0-b2e1-43fd-9dfb-1871e657ddd6 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.198159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 365/742] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:07.200659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857d2d0-b2e1-43fd-9dfb-1871e657ddd6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.268639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 378/743] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 09:57:07.269833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.297211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.303622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.313515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857d2d0-b2e1-43fd-9dfb-1871e657ddd6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:07.351660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdce29e-bee2-4d76-82fd-e21ce3840028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:07.352459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdce29e-bee2-4d76-82fd-e21ce3840028 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.352740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdce29e-bee2-4d76-82fd-e21ce3840028 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.353013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdce29e-bee2-4d76-82fd-e21ce3840028 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.363398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdce29e-bee2-4d76-82fd-e21ce3840028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6cdce29e-bee2-4d76-82fd-e21ce3840028 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:07.371041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:07.372017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:07.372882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 366/744] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:07.373580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7398d-46b5-46dd-af9b-a8082b228553 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.374448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7398d-46b5-46dd-af9b-a8082b228553 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.374448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7398d-46b5-46dd-af9b-a8082b228553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.386448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a97b2-327c-473e-815d-4fa12e090a24 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:07.391024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dec7398d-46b5-46dd-af9b-a8082b228553 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:07.392242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dec7398d-46b5-46dd-af9b-a8082b228553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:07.423108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:07.423935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.424719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.425001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.435437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:07.436946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:07.455669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:07.456585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:07.457557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:07.457557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:07.457557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:07.457557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:07.457557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 379/745] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:07.457846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.469688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 367/746] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 09:57:07.470345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7398d-46b5-46dd-af9b-a8082b228553 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.556315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.558706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.580862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7398d-46b5-46dd-af9b-a8082b228553 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:07.590880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071575e-6669-49fb-9e49-f8f1680a3f88 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:07.618901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:07.619720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.620008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.620314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.621037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:07.621348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:07.622944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:07.627178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:07.627984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.628266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.628546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.636625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 368/747] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:07.637235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.638859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:07.640346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:07.659131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:07.660134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:07.661063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:07.661063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:07.661063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:07.661063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:07.661063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 380/748] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:07.662179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.747671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651224c2-e75a-4b6b-a08c-d2b62ccc16cc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:07.774961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3dbfd-c0a4-4f17-b0a9-6a0848d05cf1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:07.795241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:07.795968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.796259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.796544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.797306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:07.797618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:07.799049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:07.807281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.816356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:07.817029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:07.817315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:07.817592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:07.822452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 369/749] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:07.822583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:07.822661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.822733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:07.827270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:07.835317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 381/750] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:07 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:07.844780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:07.947150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a4ede-212b-454b-86d4-015437ba1125 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.005197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.005940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.006227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.006506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.009052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb00e5c-a52a-4a9d-99cc-cd922c68cb27 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.021752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.022534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:08.043112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:08.044184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:08.045329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:08.045329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:08.045329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:08.045329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:08.047235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.047567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 370/751] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:08.048088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.048425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.048710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.049592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.050115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:08.050466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.052278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.066384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 382/752] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:08.067226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.116448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:08.122733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:08.174873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be884ce-4a1e-4e50-89d9-a1e418c5eca6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.185538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74af8e-ceec-4081-8704-e84c301c0c48 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.213435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.214246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.214552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.215112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.223311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.225030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.229068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.230086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.230876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.231488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.232702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:08.233607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.235403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:08.241446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:08.242396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:08.243331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 371/753] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:08.244535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.255708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 383/754] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:08.258831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.363048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de71e7-c98f-41d5-a6be-73eea5574a3c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.364975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212b30-ed60-4d8f-91ee-5e7c097b834d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.384020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:08.392500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:08.399192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.400130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.400845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.401446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.403467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.404631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.405144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.405599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.406691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:08.407184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.409431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.410233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.411815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.432033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 384/755] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:08.433101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:08.541621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:08.542755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:08.543858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:08.544536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 372/756] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:08.545449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.549896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1a80f-b4c4-45f9-8e72-d03c3c48660f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.597639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.599146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.599782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.600342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.610720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.613925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:08.633307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:08.634323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:08.635725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 385/757] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:08.636341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.663642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:08.670361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ef4d-b8cb-4ad4-84fa-a7acd1075676 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.707294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.708291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.708821 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.709399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.710420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=15dfaee01d964b2d9ed52e4474a99863) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:08.710914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.712642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.727763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 373/758] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/role_assignments?user.id=15dfaee01d964b2d9ed52e4474a99863&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:08.729218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.749808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524018-1876-4aa1-a598-2f96506b1b8b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.782726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:08.804265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32644319-b0e8-493d-8bf5-40af10d49617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.804868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644319-b0e8-493d-8bf5-40af10d49617 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.805154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644319-b0e8-493d-8bf5-40af10d49617 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.805435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32644319-b0e8-493d-8bf5-40af10d49617 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.806250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644319-b0e8-493d-8bf5-40af10d49617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:08.806568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644319-b0e8-493d-8bf5-40af10d49617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.808427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32644319-b0e8-493d-8bf5-40af10d49617 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.824919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 386/759] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:08.826348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642467-258e-4fe1-95a7-ded8a0c28430 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.826643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642467-258e-4fe1-95a7-ded8a0c28430 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.826923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642467-258e-4fe1-95a7-ded8a0c28430 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.828483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 387/760] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:08.836494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28671284-30e3-421f-8895-561de693be01 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.837072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28671284-30e3-421f-8895-561de693be01 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.837489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28671284-30e3-421f-8895-561de693be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.860154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-28671284-30e3-421f-8895-561de693be01 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:08.862305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-28671284-30e3-421f-8895-561de693be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:08.870408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a437db-520a-414a-bce6-e6ffe45c2b8a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:08.907852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:08.909084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:08.909455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:08.909727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:08.910619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:08.910929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:08.912533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:08.934495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 374/761] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:08.935558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.956087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 388/762] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:08.957090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28671284-30e3-421f-8895-561de693be01 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:08.979327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:09.045676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:09.059983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571b448-4d0d-46c5-abc2-be9df796cd2e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.083528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28671284-30e3-421f-8895-561de693be01 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.105934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.105934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.105934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.105934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.106491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=323dac67dfab4c95b3c1d6ccc9b0a701) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:09.106806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.108262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.115743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 375/763] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/role_assignments?user.id=323dac67dfab4c95b3c1d6ccc9b0a701&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:09.116701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:09.131970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.132952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.133336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.133715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.147197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.149035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:09.173508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:09.175119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:09.176073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:09.176073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:09.176073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:09.176073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:09.176639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 389/764] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:09.182725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:09.301705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:09.325890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4640fa-61d6-4447-97f9-c9afd482e6f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.346730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe00a76-bc84-4cdc-83f9-714aef236eef None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.386073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.386743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.387027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.387304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.387447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.388059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:09.388366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.388755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.389176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.389638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.389748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.390526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.392284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.402498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 390/765] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:09.417554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:09.418685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:09.419703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:09.422441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 376/766] 10.222.0.78 () {56 vars in 1129 bytes} [Mon Jul 4 09:57:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:09.427631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:09.429589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:09.474835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:09.545105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff81e4b-995c-4cb4-a0eb-e55ba60c59bc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.583071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:09.607082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.609746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.610030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.610304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.624988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.626454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.636136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc129223-b45e-495a-b23f-bc628f9c8ae4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:09.658081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:09.659653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:09.660591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:09.665691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 391/767] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:09.673862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:09.711315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.712083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.712474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.712836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.713779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:09.714049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.715485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.727756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 377/768] 10.222.0.78 () {56 vars in 1124 bytes} [Mon Jul 4 09:57:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:09.727756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:09.873048 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61f409-8b7f-4df8-b335-84cabd51fb98 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.879931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:09.907914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45534c-06d3-4ae7-8ae9-3637b656ae12 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:09.941788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.942473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.942759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.943091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.943971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:09.944290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.945728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.952279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:09.952955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:09.953249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:09.953534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:09.954262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:09.954577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:09.956560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:09.963016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 378/769] 10.222.0.78 () {56 vars in 1124 bytes} [Mon Jul 4 09:57:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:09.966159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 392/770] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:09.972737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:09.984644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:10.080999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b6874-b3da-4bcd-9146-0d2d29a18eae None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:10.111950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:10.117149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:10.117824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:10.118110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:10.118389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:10.119261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] RBAC: Adding query filter params (interface=public, service_id=71b7907262244f30871a090f83790abb, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:10.119600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:10.120980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:10.129927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 379/771] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 09:57:09 2022] GET /identity/v3/endpoints?service_id=71b7907262244f30871a090f83790abb&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:10.135143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:10.151695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:10.214592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec923-7187-4cd0-8fb4-6ac7fb5d33bf None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:10.250765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a969-97a9-42e6-95bc-f1598b41efac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:10.258198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e5239-22db-4278-aeb0-c4ea59789330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:10.259378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5239-22db-4278-aeb0-c4ea59789330 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:10.259884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5239-22db-4278-aeb0-c4ea59789330 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:10.260843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5239-22db-4278-aeb0-c4ea59789330 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3a63afc7b9514ef7b4d799b1c1538b36/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:10.263529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e5239-22db-4278-aeb0-c4ea59789330 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=3a63afc7b9514ef7b4d799b1c1538b36, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:10.265861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e5239-22db-4278-aeb0-c4ea59789330 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:10.286986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 393/772] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:57:09 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3a63afc7b9514ef7b4d799b1c1538b36/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:57:10.288722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b105-521f-4e12-92f9-a7871624ce97 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:10.289212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b105-521f-4e12-92f9-a7871624ce97 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:10.289688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247b105-521f-4e12-92f9-a7871624ce97 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:10.295423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 394/773] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:10.297876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea828d1-32cf-487a-a593-50eefb6acd92 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:10.298644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea828d1-32cf-487a-a593-50eefb6acd92 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:10.299290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea828d1-32cf-487a-a593-50eefb6acd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:10.305630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:10.307271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:10.307569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:10.308064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:10.308835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:10.315753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:10.319973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9ea828d1-32cf-487a-a593-50eefb6acd92 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:10.321973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9ea828d1-32cf-487a-a593-50eefb6acd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:10.326373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 380/774] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:10 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:10.445149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 395/775] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:10.483353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:10.603476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:10.627722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe95f7-4ac9-418d-afce-88dd2cfefd7e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:10.666102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988552-b904-414a-812b-5318caa63651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:10.666908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988552-b904-414a-812b-5318caa63651 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:10.667195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988552-b904-414a-812b-5318caa63651 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:10.667473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54988552-b904-414a-812b-5318caa63651 None admin] PATH_INFO: `/v3/services/network` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:10.668166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54988552-b904-414a-812b-5318caa63651 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:10.669530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54988552-b904-414a-812b-5318caa63651 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-54988552-b904-414a-812b-5318caa63651 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:10.682758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:10.683836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:10.684693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 381/776] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:10 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:10.690721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea828d1-32cf-487a-a593-50eefb6acd92 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:10.727406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:10.816026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea828d1-32cf-487a-a593-50eefb6acd92 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:10.874120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:10.875178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:10.875725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:10.876201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:10.877309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] RBAC: Adding query filter params (name=network) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:10.877820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:10.879422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:10.887497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 396/777] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:10.893065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988552-b904-414a-812b-5318caa63651 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:11.061655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54988552-b904-414a-812b-5318caa63651 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:11.110643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c191c-646c-4745-801b-edba54323cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:11.111320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c191c-646c-4745-801b-edba54323cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.113407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c191c-646c-4745-801b-edba54323cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.113682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c191c-646c-4745-801b-edba54323cc9 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.114412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c191c-646c-4745-801b-edba54323cc9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:11.114719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c191c-646c-4745-801b-edba54323cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:11.116136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c191c-646c-4745-801b-edba54323cc9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:11.121990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 382/778] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:11.128823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:11.249839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1928f1-3dd1-4fa1-8bcd-aa171829872e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.250163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1928f1-3dd1-4fa1-8bcd-aa171829872e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.250397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1928f1-3dd1-4fa1-8bcd-aa171829872e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.252059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 383/779] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:11.272426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140822cc-d671-4982-bb5e-42432afc70f6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.274075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140822cc-d671-4982-bb5e-42432afc70f6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.274731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140822cc-d671-4982-bb5e-42432afc70f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.291939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:11.294745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:11.298576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357390cc-e0b3-4701-8152-bda6576fb378 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:11.310257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-140822cc-d671-4982-bb5e-42432afc70f6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:11.312949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-140822cc-d671-4982-bb5e-42432afc70f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:11.364177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:11.365646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.366140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.366621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.368239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] RBAC: Adding query filter params (interface=public, service_id=0b8dc1d60dca4c76b525a187eb35445b, region_id=RegionOne) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:11.369906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:11.371513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:11.384762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 397/780] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 09:57:11 2022] GET /identity/v3/endpoints?service_id=0b8dc1d60dca4c76b525a187eb35445b&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:11.392548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:11.427288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 384/781] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:11.447039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0971ee-93c0-43cd-ae4d-34a976b1c8c0 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.447326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0971ee-93c0-43cd-ae4d-34a976b1c8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.447646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0971ee-93c0-43cd-ae4d-34a976b1c8c0 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.452783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 385/782] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:11.454144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e046086-e142-4fb7-b8d0-146a6d9e00d0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.454432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e046086-e142-4fb7-b8d0-146a6d9e00d0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.454710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e046086-e142-4fb7-b8d0-146a6d9e00d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.472467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4e046086-e142-4fb7-b8d0-146a6d9e00d0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:11.473649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4e046086-e142-4fb7-b8d0-146a6d9e00d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:11.545543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd4b63-2b0c-4aab-a55c-5a536c004817 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:11.554940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 386/783] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:11.556080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e046086-e142-4fb7-b8d0-146a6d9e00d0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:11.599239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:11.599946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.600230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.600510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.601314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:11.602808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:11.608672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 398/784] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:11 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:11.609651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:11.641662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:11.666934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:11.732180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de568df8-44fc-47bd-9b00-439d57cbd462 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:11.755479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e046086-e142-4fb7-b8d0-146a6d9e00d0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:11.795800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:11.797239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.797713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.798251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.811839 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:11.820716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:11.821708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:11.822551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:11.823355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 399/785] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:11.827221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:11.828081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:11.828370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:11.828650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:11.832141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:11.849153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:11.858370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:11.859407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:57:11.860323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:11.863888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 387/786] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:57:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:11.869710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:11.990858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:12.013824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149d356-9727-4ea1-a5ed-bc17937afb47 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.042628 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e0f46-54c5-4373-a044-a95440c57346 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.070939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:12.085634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.086245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.086524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.086795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.087542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:12.087874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.089228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.096968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.097636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.097913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.098182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.098923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:12.099226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.100975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.107213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 388/787] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:57:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:12.118094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:12.118531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 400/788] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:12.121728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:12.293012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa950d-a457-45e7-983a-7b7987ff583b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.305478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e0396-c140-4858-ba80-624fc42b7bd3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.359687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.360422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.360702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.360972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.363481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.364297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.364849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.364849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.376317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.377811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.392487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.393979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:12.395358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:12.396269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:12.397176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:12.397176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:12.397176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:12.397176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:12.401420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 401/789] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:12.402754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:12.416994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:12.417934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:12.418928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:12.418928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:12.418928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:12.418928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:12.418928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 389/790] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:12.419211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:12.425023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:12.471565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:12.537572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe257f-b4f8-4073-a122-e9539215edd6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.573965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.574648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.574931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.575207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.579601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:12.579601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.579601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.591519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 390/791] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:12.598432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:12.645644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cc491-9aae-47f6-98d7-0cab971eb879 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.708962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.709644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.709931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.710208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.710946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:12.711251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.718038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.748310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 402/792] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:12.754442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:12.792659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:12.795637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72668f-5868-499e-9ebe-cc596c64ef9f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.833938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b4ae9-5578-43f6-b25b-643a16b86ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.835145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b4ae9-5578-43f6-b25b-643a16b86ffa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.835500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b4ae9-5578-43f6-b25b-643a16b86ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.835808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b4ae9-5578-43f6-b25b-643a16b86ffa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.851807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b4ae9-5578-43f6-b25b-643a16b86ffa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.854702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b4ae9-5578-43f6-b25b-643a16b86ffa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.867827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b18b4ae9-5578-43f6-b25b-643a16b86ffa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:12.894770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:12.895876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:12.896859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:12.903712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 391/793] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 09:57:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:12.905475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07afe-7bac-42a9-b925-f4875584b22c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.905983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07afe-7bac-42a9-b925-f4875584b22c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.906547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07afe-7bac-42a9-b925-f4875584b22c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.909004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 392/794] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:12.910465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16f69-ddb4-4aba-9174-f0a64103bb0b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.910967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16f69-ddb4-4aba-9174-f0a64103bb0b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.911513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16f69-ddb4-4aba-9174-f0a64103bb0b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.913334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 393/795] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:12.914624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16f69-ddb4-4aba-9174-f0a64103bb0b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:12.922326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96972d0-f8f8-43e5-8b99-48b185d4892d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:12.964524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5a514-f322-44de-8829-5d9b4000581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:12.965320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a514-f322-44de-8829-5d9b4000581c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.965596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a514-f322-44de-8829-5d9b4000581c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.965875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a514-f322-44de-8829-5d9b4000581c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:12.973890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5a514-f322-44de-8829-5d9b4000581c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:12.975534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5a514-f322-44de-8829-5d9b4000581c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-05f5a514-f322-44de-8829-5d9b4000581c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:12.991036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:12.993419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 403/796] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa26ed-8ca0-485a-850f-5e07291f4d2c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:12.994394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa26ed-8ca0-485a-850f-5e07291f4d2c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:12.995110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa26ed-8ca0-485a-850f-5e07291f4d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.011923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f1fa26ed-8ca0-485a-850f-5e07291f4d2c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:13.013294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f1fa26ed-8ca0-485a-850f-5e07291f4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:13.035946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16f69-ddb4-4aba-9174-f0a64103bb0b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.078092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.078805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.079099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.079377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.080829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:13.081147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.082590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.100686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 404/797] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:13.102309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253250f8-e77e-4c99-ab41-2b43eb8ac250 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.102786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253250f8-e77e-4c99-ab41-2b43eb8ac250 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.103244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253250f8-e77e-4c99-ab41-2b43eb8ac250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.114166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 394/798] 10.222.0.78 () {56 vars in 1149 bytes} [Mon Jul 4 09:57:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:13.115015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.125120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-253250f8-e77e-4c99-ab41-2b43eb8ac250 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:13.126594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-253250f8-e77e-4c99-ab41-2b43eb8ac250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:13.142400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.178794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.200960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 405/799] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:13.201796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253250f8-e77e-4c99-ab41-2b43eb8ac250 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.250845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54458063-79cb-4af1-86e6-a6c8d9385778 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.290087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.290760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.291066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.291321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.292201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:13.292513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.293938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.308429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253250f8-e77e-4c99-ab41-2b43eb8ac250 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.318586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 395/800] 10.222.0.78 () {56 vars in 1135 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:13.318586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.345083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.346470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.346752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.347025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.357772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.359233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:13.377214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:13.378774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:13.380423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:13.380423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:13.380423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:13.380423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:13.383130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 406/801] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:13.384034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.403266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.421756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.430075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750595-2bc9-4638-8aa4-b70d68457231 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.465874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.466679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.466960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.467224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.467904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.469262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:13.483521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:13.485042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:13.485872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 396/802] 10.222.0.78 () {56 vars in 1129 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:13.486781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.505666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f283f-f332-41a5-9fd9-be7c7063a25c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.546463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.547349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.547667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.547945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.561859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:13.570149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:13.571154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:13.572056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 407/803] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:13.577518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.602261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139dfed-82f1-4f64-8dd7-ac2e72388eca None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.640032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.640840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.641124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.641405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.651452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.654537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.656593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:13.676292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:13.677480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:13.678374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:13.678374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:13.678374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:13.678374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:13.678374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 397/804] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:13.678657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.684313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.691684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4296b-299d-4745-aa78-2e398f8bde9d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.732345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.733414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.734233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.734699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.736934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:13.737556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.740586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.754363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 408/805] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:13.755186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.804023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bdfc4-44ba-4d86-9e8e-21c663cd3096 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.841405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.842084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.842375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.842658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.843382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:13.843738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.845547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.855623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 398/806] 10.222.0.78 () {56 vars in 1124 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:13.855623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.876290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708933e7-108b-447a-b670-f6aff82a480b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:13.914181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:13.914754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.915182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:13.915656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:13.915948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:13.916854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:13.917224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:13.919198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:13.932411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 409/807] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:13.932411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:13.950470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:13.968067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670f94f-ba02-48dd-9355-40d87ef49441 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.003029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.003734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.004020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.004297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.005024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:14.005346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.006702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.019360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 399/808] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:14.020181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.039469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53f8c2-c597-4b3f-b394-a184b8ef5935 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.074386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.075180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.075467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.075782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.082882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.084417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:14.100225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:14.101332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 410/809] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:14.102519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.124838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e6666-5db8-4b69-ba9d-a338421cc27b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.141837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:14.160030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475898f-d489-4f76-8a81-748ce3a3404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.160697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475898f-d489-4f76-8a81-748ce3a3404b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.160979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475898f-d489-4f76-8a81-748ce3a3404b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.161253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475898f-d489-4f76-8a81-748ce3a3404b None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.161974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475898f-d489-4f76-8a81-748ce3a3404b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:14.162282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475898f-d489-4f76-8a81-748ce3a3404b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.163672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475898f-d489-4f76-8a81-748ce3a3404b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.168518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 400/810] 10.222.0.78 () {56 vars in 1124 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:14.169775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b043-76f0-4f9c-9095-e20c9dc356f1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.170067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b043-76f0-4f9c-9095-e20c9dc356f1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.170341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b043-76f0-4f9c-9095-e20c9dc356f1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.171586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 401/811] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:14.172272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7b043-76f0-4f9c-9095-e20c9dc356f1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.185781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:14.209686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d5bd-a2fd-406e-8987-9123caebf4d6 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.245930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.246723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.247014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.247287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.257963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.259444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:14.278341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:14.279460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:14.280450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:14.280450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:14.280450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:14.280450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:14.280677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7b043-76f0-4f9c-9095-e20c9dc356f1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.280761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 411/812] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:14.280761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.321464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.322258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.322538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.322805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.329508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.331597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:14.345089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:14.346086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:14.347001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 402/813] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:14.347516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.384834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cf00-0cd3-45e7-b8a4-c6357b24c8e7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.389584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:14.411719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:14.420140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0c347-a365-4725-b16d-0f56d7cc00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.420912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0c347-a365-4725-b16d-0f56d7cc00fd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.421200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0c347-a365-4725-b16d-0f56d7cc00fd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.421478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0c347-a365-4725-b16d-0f56d7cc00fd None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.422270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0c347-a365-4725-b16d-0f56d7cc00fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:14.422581 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0c347-a365-4725-b16d-0f56d7cc00fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.424073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0c347-a365-4725-b16d-0f56d7cc00fd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.435921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 412/814] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:14.437127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a745cb-1622-4edd-a9ba-2ec17d6f2852 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.437416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a745cb-1622-4edd-a9ba-2ec17d6f2852 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.437692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a745cb-1622-4edd-a9ba-2ec17d6f2852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.449058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7475485-42b8-436a-81f2-985821329e21 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.454471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f7a745cb-1622-4edd-a9ba-2ec17d6f2852 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:14.456330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f7a745cb-1622-4edd-a9ba-2ec17d6f2852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:14.482326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.482914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.483191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.483463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.484226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.485576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.506406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 403/815] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:14.507221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.529357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 413/816] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:14.530240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a745cb-1622-4edd-a9ba-2ec17d6f2852 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.659306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:14.661037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a745cb-1622-4edd-a9ba-2ec17d6f2852 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.667961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fa5a1-d13e-4406-8cd2-3356ac584ccd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.679629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:14.710635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.711144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.711359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.711621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.711854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.711965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.712144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.712425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.712656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:14.712970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.713233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:14.713547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.714351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.714977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.731935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 404/817] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:14.731935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.732608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 414/818] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:14.732608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.835479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74bf24-7cf1-4477-9b3a-5b66dad56fef None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.841413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af60cd-1630-4d42-bc4e-4f46e245cf1b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:14.874789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.875716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.875998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.876274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/15dfaee01d964b2d9ed52e4474a99863/roles/4ffa6416473b43719c4b6241a1af7b13` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.878690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:14.879494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:14.879809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:14.880084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] PATH_INFO: `/v3/services/network` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:14.880746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.882130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.893644 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=15dfaee01d964b2d9ed52e4474a99863, role_id=4ffa6416473b43719c4b6241a1af7b13)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:14.894963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:14.896016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 09:57:14.897314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:14.898174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:14.898247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 415/819] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:14.898247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.917859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 405/820] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:57:14 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/15dfaee01d964b2d9ed52e4474a99863/roles/4ffa6416473b43719c4b6241a1af7b13 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:57:14.918686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:14.934300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:14.953646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:15.036526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864beb9-40a0-4e3c-8776-b0a36f52d864 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:15.054422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752e82-d75d-48f7-ad68-c78c02e088fc None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:15.077704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:15.078823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:15.079273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:15.079659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/323dac67dfab4c95b3c1d6ccc9b0a701/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:15.081929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=323dac67dfab4c95b3c1d6ccc9b0a701, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:15.083661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:15.101029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 416/821] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:57:14 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/323dac67dfab4c95b3c1d6ccc9b0a701/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:57:15.101424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:15.102235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:15.102746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:15.103208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:15.103663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:15.114993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:15.117697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:15.138428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:15.139671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:15.140847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:15.147856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 406/822] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:57:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:15.150907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:15.248487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:15.254024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:15.259620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8d613-2826-458f-bff7-9f4c928cec44 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:15.294399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4d1cf-5e91-41a5-9dd4-a35b0f35800a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:15.301298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:15.302483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:15.302913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:15.303332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:15.304213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] RBAC: Adding query filter params (name=network) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:15.304678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:15.306212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:15.311500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 417/823] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:15.318828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:15.343733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:15.344706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:15.345161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:15.345623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:15.346637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:15.347104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:15.348835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:15.368596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 407/824] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:57:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:15.375135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:15.436759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fac821-960f-4b4d-a795-d81654da6bfd None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:15.472831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:15.473500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:15.473781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:15.474054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:15.474763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] RBAC: Adding query filter params (type=network) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:15.475065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:15.476449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:15.481857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 418/825] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:15.487527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:15.490361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2c79-19b9-4c64-8865-54e1440fa88e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:15.515714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:15.517032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:15.532027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:15.533060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:15.534087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:15.534599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:15.644103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:15.646574 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:15.651282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669b39-5da7-4e8d-9ceb-3ae4480acf56 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:15.695173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:15.695871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:15.696167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:15.696446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:15.697472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:15.699298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:15.749178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 419/826] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:57:15.800287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 408/827] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:57:15.806616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:15.946988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:15.978221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cc9c-8508-4a06-becb-df502ca1f373 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:16.015148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:16.015980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:16.016265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:16.016542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:16.028112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:16.029579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:16.047134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:16.048131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:16.049079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:16.049079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:16.049079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:16.049079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:16.049079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 420/828] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:16.055429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:16.084185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:16.181981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af902-442b-496f-b643-4ed41fc611d7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:16.226087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:16.226679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:16.226963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:16.227240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:16.228011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:16.228324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:16.229747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:16.242641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 409/829] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:16.250260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:16.368602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818ab7-c020-45a5-8521-ed58de7bcba1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:16.398928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:16.404847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:16.405644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:16.405925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:16.406199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:16.414169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:16.415655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:16.430610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:16.431613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:16.432623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 421/830] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:16.439645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:16.532144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:16.545972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76d5a4-fab9-4a7a-9dcd-9642adfa12cb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:16.582988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e9b48-ce6f-43d8-8833-6c02c735fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:16.583693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9b48-ce6f-43d8-8833-6c02c735fdcf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:16.583983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9b48-ce6f-43d8-8833-6c02c735fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:16.584266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9b48-ce6f-43d8-8833-6c02c735fdcf None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:16.585148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e9b48-ce6f-43d8-8833-6c02c735fdcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:16.585464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e9b48-ce6f-43d8-8833-6c02c735fdcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:16.586988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e9b48-ce6f-43d8-8833-6c02c735fdcf None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:16.602103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 410/831] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:16.607997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:16.709237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c7699-89f7-4fac-97d9-5fe212c64c6a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:16.744683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f17de-a842-428f-96f3-d0c91229088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:16.745346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f17de-a842-428f-96f3-d0c91229088f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:16.745629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f17de-a842-428f-96f3-d0c91229088f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:16.745903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f17de-a842-428f-96f3-d0c91229088f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:16.746742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f17de-a842-428f-96f3-d0c91229088f None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3a63afc7b9514ef7b4d799b1c1538b36) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:16.747056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f17de-a842-428f-96f3-d0c91229088f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:16.748511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f17de-a842-428f-96f3-d0c91229088f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:16.755394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 422/832] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:16 2022] GET /identity/v3/role_assignments?user.id=3a63afc7b9514ef7b4d799b1c1538b36&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:16.926265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ac95-958c-462e-b8ca-9de9d0009ba4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:16.926617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ac95-958c-462e-b8ca-9de9d0009ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:16.926984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ac95-958c-462e-b8ca-9de9d0009ba4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:16.928684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 411/833] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:16.934084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332cadf-8336-4d90-b415-cc265ed92589 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:16.934377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332cadf-8336-4d90-b415-cc265ed92589 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:16.934655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332cadf-8336-4d90-b415-cc265ed92589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:16.952336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5332cadf-8336-4d90-b415-cc265ed92589 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:16.953532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5332cadf-8336-4d90-b415-cc265ed92589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:17.005941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:17.027683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 423/834] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:17.045500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ac95-958c-462e-b8ca-9de9d0009ba4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.157855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ac95-958c-462e-b8ca-9de9d0009ba4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:17.195796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127c4e-f830-4fd7-9381-7c6166540243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:17.196606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127c4e-f830-4fd7-9381-7c6166540243 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.196892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127c4e-f830-4fd7-9381-7c6166540243 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.197173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127c4e-f830-4fd7-9381-7c6166540243 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.197838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6127c4e-f830-4fd7-9381-7c6166540243 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:17.199210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6127c4e-f830-4fd7-9381-7c6166540243 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c6127c4e-f830-4fd7-9381-7c6166540243 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:17.211695 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:17.212746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:17.213823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 412/835] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:17.218852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332cadf-8336-4d90-b415-cc265ed92589 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.327193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1000e44-b5ba-4c94-b1f4-bb15ef29576a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.327600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1000e44-b5ba-4c94-b1f4-bb15ef29576a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.327785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1000e44-b5ba-4c94-b1f4-bb15ef29576a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.329397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 413/836] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:17.337083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a03b-15b0-4cc4-a34b-214401d601bd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.337570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a03b-15b0-4cc4-a34b-214401d601bd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.337947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a03b-15b0-4cc4-a34b-214401d601bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.347664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332cadf-8336-4d90-b415-cc265ed92589 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:17.361774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-85d4a03b-15b0-4cc4-a34b-214401d601bd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:17.363426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-85d4a03b-15b0-4cc4-a34b-214401d601bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:17.366357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:17.388198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:17.389269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.389756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.390180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.391042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:17.391510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:17.393843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:17.399316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 424/837] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:17.411618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.459013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:17.462324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 414/838] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:17.486788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4a03b-15b0-4cc4-a34b-214401d601bd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.513406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cd5f2-ca52-4763-b8c9-49cff86e246f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:17.557533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b77888-14dd-461e-a3b0-0984c23b9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:17.558316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77888-14dd-461e-a3b0-0984c23b9012 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.558898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77888-14dd-461e-a3b0-0984c23b9012 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.559034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77888-14dd-461e-a3b0-0984c23b9012 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.560181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b77888-14dd-461e-a3b0-0984c23b9012 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:17.560181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b77888-14dd-461e-a3b0-0984c23b9012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:17.561614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b77888-14dd-461e-a3b0-0984c23b9012 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:17.570429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 425/839] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:17.572426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286715a-eb5a-4005-bbfc-85ca6cc35038 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.572882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286715a-eb5a-4005-bbfc-85ca6cc35038 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.573431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286715a-eb5a-4005-bbfc-85ca6cc35038 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.575442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 426/840] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:17.586051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249e21b-9064-4913-8007-948ea738be15 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.586396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249e21b-9064-4913-8007-948ea738be15 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.586695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249e21b-9064-4913-8007-948ea738be15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.610778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4a03b-15b0-4cc4-a34b-214401d601bd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:17.616124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b249e21b-9064-4913-8007-948ea738be15 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:17.617938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b249e21b-9064-4913-8007-948ea738be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:17.653703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:17.654637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.655012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.655358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.664343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:17.669194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:17.679341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:17.680397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:17.686669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 415/841] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:17.688596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.727710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 427/842] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:17.744433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249e21b-9064-4913-8007-948ea738be15 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.795129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:17.825159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90a25-1fa4-4db3-882a-f87aed3ca6bf None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:17.867122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249e21b-9064-4913-8007-948ea738be15 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:17.872133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:17.873020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.873465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.873890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.874797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:17.875725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:17.877650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:17.894032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 416/843] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:17.895748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.912485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:17.913349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:17.913631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:17.914110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:17.928754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:17.940324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:17.941304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:17.942162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:17.944169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 428/844] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:17.947886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:17.982446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:18.030404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce025217-3110-4df2-9e1a-980a34dbeea8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.077522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726211e-fa39-47be-ac05-497b21e012e9 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.077834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.078598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.078879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.079161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.080512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:18.092737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.094190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:18.113994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:18.114969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:18.115945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:18.115945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:18.115945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:18.115945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:18.119899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 417/845] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:18.120835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.124902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.125884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.126408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.126935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.127936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:18.128517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.130204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.144542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 429/846] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:18.145906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.230826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297756a-9ab1-42c5-b3bc-81a01aff7e01 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.245595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:18.260136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d69f-2571-47f0-8974-b06c7ab3d856 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.270886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.271559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.271889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.272169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.273027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:18.273327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.274860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.292806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 418/847] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:18.293762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.301939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.303084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.303938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.304444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.317016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.318901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:18.338375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:18.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:18.340295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:18.340295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:18.340295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:18.340295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:18.347710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 430/848] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:18.349009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.370317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:18.405590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450f107-2cb5-49f5-a2b9-b4e422b3ce1b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.442930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.443778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.444061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.444335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.452254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.453803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.466549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b0c57-adbb-4786-8597-37a5bc06e4b5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:18.470320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:18.471335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:18.472332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:18.476295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 419/849] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:18.477785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.508596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.509510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.510006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.510435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.511433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:18.512159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:18.512783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.514327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.533052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 431/850] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:18.534450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.589656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f13339-ef9b-4c7e-830e-e73c7d5082ed None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.628309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.629184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.629567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.629947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.630932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:18.631344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.633014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.635258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:18.661540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 420/851] 10.222.0.78 () {56 vars in 1149 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:18.661954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2b74-e45a-46f5-9abe-bb7bf77c5aab None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.663044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.704188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.705533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.705816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.706091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.713580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.715042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:18.731637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:18.732676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:18.733643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 432/852] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:18.739531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:18.788354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:18.800811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6af7b-1cad-4dc1-91e9-2ae3be9a859f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:18.841088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030fb4d-bc7f-41c0-bf06-489c568a4578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:18.841791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030fb4d-bc7f-41c0-bf06-489c568a4578 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:18.842074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030fb4d-bc7f-41c0-bf06-489c568a4578 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:18.842349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030fb4d-bc7f-41c0-bf06-489c568a4578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:18.923412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030fb4d-bc7f-41c0-bf06-489c568a4578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:18.925838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030fb4d-bc7f-41c0-bf06-489c568a4578 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.002354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5446-6ec3-4afe-81aa-689caa230d4c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.031699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.036630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfac36-8adc-4742-a4c5-5f260b1f45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.037313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfac36-8adc-4742-a4c5-5f260b1f45c8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.037599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfac36-8adc-4742-a4c5-5f260b1f45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.037875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfac36-8adc-4742-a4c5-5f260b1f45c8 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.038774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfac36-8adc-4742-a4c5-5f260b1f45c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:19.039039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfac36-8adc-4742-a4c5-5f260b1f45c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.040548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfac36-8adc-4742-a4c5-5f260b1f45c8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.049506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.049697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 421/853] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:57:19.049697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa67be-a7b2-4c48-934d-57e59d2348cb None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.049697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa67be-a7b2-4c48-934d-57e59d2348cb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.049697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa67be-a7b2-4c48-934d-57e59d2348cb None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.049697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 422/854] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:19.049697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa67be-a7b2-4c48-934d-57e59d2348cb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.060225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 433/855] 10.222.0.78 () {56 vars in 1135 bytes} [Mon Jul 4 09:57:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:19.062270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ad852-7a08-4faf-a924-fbae8502dc16 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.062270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ad852-7a08-4faf-a924-fbae8502dc16 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.062270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ad852-7a08-4faf-a924-fbae8502dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.080480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d08ad852-7a08-4faf-a924-fbae8502dc16 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:19.081740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d08ad852-7a08-4faf-a924-fbae8502dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:19.153869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 434/856] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:19.154807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ad852-7a08-4faf-a924-fbae8502dc16 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.184857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa67be-a7b2-4c48-934d-57e59d2348cb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.223810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.224557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.224837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.225227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.236703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.238496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:19.257733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:19.258854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:19.259902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:19.259902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:19.259902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:19.259902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:19.259902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 423/857] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:19.260558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.272583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ad852-7a08-4faf-a924-fbae8502dc16 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.301033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.306664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.315106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.315965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.316330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.316701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.370082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97ddf1-0f5d-457b-a935-9b88bf18f077 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.391541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.393683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.405408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.406224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.406509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.406788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.407442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.409382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:19.421470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:19.422433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:19.423284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 424/858] 10.222.0.78 () {56 vars in 1132 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:19.424206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.497949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 435/859] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:57:19.503366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.530083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.534205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a71ac8-43fd-42b1-b01b-5af15cc61d34 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.543539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.580859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.581529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.581809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.582080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.582816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:19.583123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.584515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.601256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 425/860] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:19.601256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.624345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486edd-01cf-4915-9342-06b8da293071 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.662327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.662988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.662988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.663215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.663941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:19.664252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.665641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.675777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 436/861] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:19.675777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.708709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eb014-e7ea-4afc-96c5-89586f3c5369 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.741719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.742504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.742787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.743061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.754488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.755963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.761879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:19.773778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:19.774968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:19.776072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:19.776072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:19.776072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:19.776072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:19.776311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa8517-946e-41f2-9a07-c39f85719e32 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.776384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 426/862] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:19.776384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.796921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:19.810595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aba0b-4876-4f1d-b8e3-9a064d369c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.811384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aba0b-4876-4f1d-b8e3-9a064d369c03 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.811689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aba0b-4876-4f1d-b8e3-9a064d369c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.811960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aba0b-4876-4f1d-b8e3-9a064d369c03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.818574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aba0b-4876-4f1d-b8e3-9a064d369c03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.820039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aba0b-4876-4f1d-b8e3-9a064d369c03 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9c9aba0b-4876-4f1d-b8e3-9a064d369c03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:19.833606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:19.834503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:19.835459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 437/863] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:19.836013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21f68-e652-4e33-9467-91e3dc90544c None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.836299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21f68-e652-4e33-9467-91e3dc90544c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.836521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21f68-e652-4e33-9467-91e3dc90544c None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.837765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 438/864] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:19.838448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21f68-e652-4e33-9467-91e3dc90544c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.889035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5a8d-951a-4149-9168-1cb2d55dfdf3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.922616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.923280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.924188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.924468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.925186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:19.925494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:19.927106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:19.931969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 427/865] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:19.932585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:19.952530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21f68-e652-4e33-9467-91e3dc90544c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:19.996814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208123ee-12ec-40e1-be37-b037a910f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:19.997481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208123ee-12ec-40e1-be37-b037a910f60f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:19.997762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208123ee-12ec-40e1-be37-b037a910f60f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:19.998033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208123ee-12ec-40e1-be37-b037a910f60f None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:19.998782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208123ee-12ec-40e1-be37-b037a910f60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:19.999196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208123ee-12ec-40e1-be37-b037a910f60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:20.000523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208123ee-12ec-40e1-be37-b037a910f60f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:20.018980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 439/866] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:20.018980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae1ab-c113-495f-9e4c-42d8de83a84b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:20.018980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae1ab-c113-495f-9e4c-42d8de83a84b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:20.018980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ae1ab-c113-495f-9e4c-42d8de83a84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:20.027822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:20.037856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-025ae1ab-c113-495f-9e4c-42d8de83a84b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:20.039067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-025ae1ab-c113-495f-9e4c-42d8de83a84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:20.041511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:20.051180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea54a9-5fb9-47bd-b76b-1654e392b989 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:20.094047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:20.094814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:20.095510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:20.095826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:20.097312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:20.097312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:20.098381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:20.114355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 428/867] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:20.115838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:20.127740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 440/868] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:20.128711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ae1ab-c113-495f-9e4c-42d8de83a84b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:20.233870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023765e5-2d20-48bb-ab0e-816e73d12d68 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:20.234075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ae1ab-c113-495f-9e4c-42d8de83a84b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:20.271002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:20.271215 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:20.272054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:20.272336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:20.272610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:20.272854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:20.273325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:20.273794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:20.274827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=15dfaee01d964b2d9ed52e4474a99863) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:20.275376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:20.276923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:20.279828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:20.281259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:20.283972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 441/869] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:20 2022] GET /identity/v3/role_assignments?user.id=15dfaee01d964b2d9ed52e4474a99863&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:20.292641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:20.296159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:20.297098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:20.298030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:20.302021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:20.303221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 429/870] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:20.305540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:20.308701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:20.441697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5e10-cb31-47f5-9d77-b0a6de927f0a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:20.453967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11733087-24e4-4eeb-bebf-03fa6e513c64 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:20.485584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:20.486499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:20.486852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:20.487317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:20.488017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:20.488291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:20.489727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:20.499095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba490a-1f72-4f20-b58e-bc8f0b5fc44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:20.499798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba490a-1f72-4f20-b58e-bc8f0b5fc44a None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:20.500080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba490a-1f72-4f20-b58e-bc8f0b5fc44a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:20.500354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba490a-1f72-4f20-b58e-bc8f0b5fc44a None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:20.501080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba490a-1f72-4f20-b58e-bc8f0b5fc44a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:20.502980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba490a-1f72-4f20-b58e-bc8f0b5fc44a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:20.509779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 430/871] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:20.511107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:20.520081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 442/872] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:20 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:20.583343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:20.627782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb1ca-b303-46f4-a707-25d7aaaeef86 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:20.675559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f9c9c-b05c-4bb0-9cdf-0c9fda031e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:20.676341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9c9c-b05c-4bb0-9cdf-0c9fda031e66 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:20.676945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9c9c-b05c-4bb0-9cdf-0c9fda031e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:20.677298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f9c9c-b05c-4bb0-9cdf-0c9fda031e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:20.678222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f9c9c-b05c-4bb0-9cdf-0c9fda031e66 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=323dac67dfab4c95b3c1d6ccc9b0a701) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:20.678608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f9c9c-b05c-4bb0-9cdf-0c9fda031e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:20.680150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f9c9c-b05c-4bb0-9cdf-0c9fda031e66 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:20.686854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 431/873] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:20 2022] GET /identity/v3/role_assignments?user.id=323dac67dfab4c95b3c1d6ccc9b0a701&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:22.011223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580753-e553-460e-b11e-30b171dfc013 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.011788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580753-e553-460e-b11e-30b171dfc013 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.011788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa580753-e553-460e-b11e-30b171dfc013 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.013398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 443/874] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:22.018627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc71f-1772-49f9-8b57-4dba72676cde None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.019024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc71f-1772-49f9-8b57-4dba72676cde None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.019192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc71f-1772-49f9-8b57-4dba72676cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.036375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-657cc71f-1772-49f9-8b57-4dba72676cde None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:22.037561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-657cc71f-1772-49f9-8b57-4dba72676cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:22.105964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 432/875] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:22.128836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa580753-e553-460e-b11e-30b171dfc013 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:22.197836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:22.234972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa580753-e553-460e-b11e-30b171dfc013 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:22.273679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ae159-ba24-4e96-b974-6c9a3d6fd6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:22.274579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ae159-ba24-4e96-b974-6c9a3d6fd6a3 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.275036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ae159-ba24-4e96-b974-6c9a3d6fd6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.275511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ae159-ba24-4e96-b974-6c9a3d6fd6a3 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.276870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ae159-ba24-4e96-b974-6c9a3d6fd6a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:22.278930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ae159-ba24-4e96-b974-6c9a3d6fd6a3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:22.297238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 444/876] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:22 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:22.612900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f086-726e-43cd-87bf-3391500c8a3b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.613541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f086-726e-43cd-87bf-3391500c8a3b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.614066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f086-726e-43cd-87bf-3391500c8a3b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.616051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 433/877] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:22.621526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1c82-6db9-41cf-8d4b-c9c66308d734 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.622055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1c82-6db9-41cf-8d4b-c9c66308d734 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.622540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1c82-6db9-41cf-8d4b-c9c66308d734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.640462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-636c1c82-6db9-41cf-8d4b-c9c66308d734 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:22.640646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fe1f-ba79-4b97-9ab5-28bab5f22343 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.640873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fe1f-ba79-4b97-9ab5-28bab5f22343 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.641105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fe1f-ba79-4b97-9ab5-28bab5f22343 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.643189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-636c1c82-6db9-41cf-8d4b-c9c66308d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:22.643394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 434/878] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:22.648671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7109b2-aa52-4a67-b1b5-b7b6d8e0c60d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.648963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7109b2-aa52-4a67-b1b5-b7b6d8e0c60d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.649246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7109b2-aa52-4a67-b1b5-b7b6d8e0c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.670275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2d7109b2-aa52-4a67-b1b5-b7b6d8e0c60d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:22.671863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d7109b2-aa52-4a67-b1b5-b7b6d8e0c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:22.723375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:22.743622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 445/879] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:22.750748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 435/880] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:22.766047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1c82-6db9-41cf-8d4b-c9c66308d734 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:22.776295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7109b2-aa52-4a67-b1b5-b7b6d8e0c60d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:22.819829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:22.881489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1c82-6db9-41cf-8d4b-c9c66308d734 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:22.890466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7109b2-aa52-4a67-b1b5-b7b6d8e0c60d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:22.918864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c3d82-ffb2-4652-9060-9bf7ff94ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:22.919698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3d82-ffb2-4652-9060-9bf7ff94ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.920026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3d82-ffb2-4652-9060-9bf7ff94ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.920293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3d82-ffb2-4652-9060-9bf7ff94ccd2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.926130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:22.927183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.927465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.927767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.928430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:22.929787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:22.931670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3d82-ffb2-4652-9060-9bf7ff94ccd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-5a4c3d82-ffb2-4652-9060-9bf7ff94ccd2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:22.939768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:22.940702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:22.942177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 446/881] 10.222.0.78 () {56 vars in 1120 bytes} [Mon Jul 4 09:57:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:22.942900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:22.943840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:22.945085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:22.946881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f956a-c16e-4658-a313-28fd975c1e5e None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:22.946881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f956a-c16e-4658-a313-28fd975c1e5e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:22.946881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f956a-c16e-4658-a313-28fd975c1e5e None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:22.948068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 436/883] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:22.948297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 447/883] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:22.948779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:22.949103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f956a-c16e-4658-a313-28fd975c1e5e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:22.996973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.053776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22c90a-2e2b-4378-87d3-fae7653cdeb0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.059600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f956a-c16e-4658-a313-28fd975c1e5e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.069728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.090063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.091197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.091981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.092689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.093619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:23.094109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.096255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.096850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ca694-c5be-4cb4-b37b-ca9779875df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.097509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ca694-c5be-4cb4-b37b-ca9779875df7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.097793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ca694-c5be-4cb4-b37b-ca9779875df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.098070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ca694-c5be-4cb4-b37b-ca9779875df7 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.098772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ca694-c5be-4cb4-b37b-ca9779875df7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:23.099079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ca694-c5be-4cb4-b37b-ca9779875df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.100548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ca694-c5be-4cb4-b37b-ca9779875df7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.105548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 448/884] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:23.106809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3961-2efc-4d3c-ba56-761998f96c7a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.107100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3961-2efc-4d3c-ba56-761998f96c7a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.107388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3961-2efc-4d3c-ba56-761998f96c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.107894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 437/885] 10.222.0.78 () {56 vars in 1115 bytes} [Mon Jul 4 09:57:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:23.110792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.124506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-69ea3961-2efc-4d3c-ba56-761998f96c7a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:23.125704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-69ea3961-2efc-4d3c-ba56-761998f96c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:23.212478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 449/886] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:23.213736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea3961-2efc-4d3c-ba56-761998f96c7a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.246656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0d992-508e-499a-8911-2523b19cc70c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.256508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.285698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.286431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.286713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.286987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.287736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:23.288042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.289401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.299828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 438/887] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:23.299828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.336038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea3961-2efc-4d3c-ba56-761998f96c7a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.338507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.374148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.375006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.375287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.375618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.385706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.387169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.410443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5187f74-f30b-4d10-ab7b-602b46a4623a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:23.411761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:23.412746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:23.413660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:23.413660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:23.413660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:23.413660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:23.414347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 450/888] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:23.415090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.453780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.455798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.456245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.456719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.457497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.459002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:23.472960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:23.474191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:23.475044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 439/889] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:23.475899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.515864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.536241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5d79-2e98-44f9-961f-47ca67e8882c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.583005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.583910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.584369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.584802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.585802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] RBAC: Adding query filter params (interface=public, service_id=7d061a48d10c4cdea4d3f2e1e36d72b0, region_id=RegionOne) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:23.586262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.587852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.592210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325a5c9-2613-4e00-b0c4-645cf6dfe03c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.593898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 451/890] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/endpoints?service_id=7d061a48d10c4cdea4d3f2e1e36d72b0&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:23.594900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.614190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.633039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.633719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.634008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.634286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.635021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:23.635331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.636736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.649217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 440/891] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:23.650014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.709031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f739e5d-dd12-4675-9564-504c01ee284e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.743381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.744001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.744286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.744562 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.745272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:23.745579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.746943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.752390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 452/892] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:23.753235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.757168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.763780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94e77c-670f-424f-a17e-4e01dc7b5e2c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.800572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.801993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.802460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.803008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.803904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.805562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.811990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 441/893] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:57:23.812963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:23.857590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:23.884766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ee50-96e2-4cf8-9745-e5cf6393b03e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.942488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:23.943441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:23.943836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:23.944186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:23.954145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:23.957044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:23.966392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752df97-17c5-4e82-bc54-f59bcd1a378d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:23.978319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:23.979525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:23.980596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:23.981140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 453/894] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:23.986994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.020119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:24.021358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.022095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.022994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.024231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:24.024776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:24.027517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:24.033609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 442/895] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:24.108267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27dd2-4adc-4ca2-9db7-37c193d54924 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:24.148961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db1e13-02cf-431c-b031-00fdeb91f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:24.149654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db1e13-02cf-431c-b031-00fdeb91f5cc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.149933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db1e13-02cf-431c-b031-00fdeb91f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.150207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db1e13-02cf-431c-b031-00fdeb91f5cc None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.151067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db1e13-02cf-431c-b031-00fdeb91f5cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:24.151379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db1e13-02cf-431c-b031-00fdeb91f5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:24.152900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db1e13-02cf-431c-b031-00fdeb91f5cc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:24.169630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:24.175175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 454/896] 10.222.0.78 () {56 vars in 1149 bytes} [Mon Jul 4 09:57:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:24.181185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.218769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:24.302416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c925-fa89-4ac6-a2cd-47018c4ff735 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:24.343903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:24.344975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.345535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.346039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.389769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf408-885d-4d02-afb8-3b42eadfcedc None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.390119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf408-885d-4d02-afb8-3b42eadfcedc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.390384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf408-885d-4d02-afb8-3b42eadfcedc None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.392671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 455/897] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:24.397965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739bcb9-625e-428b-94b6-863b03b0a8a6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.398799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739bcb9-625e-428b-94b6-863b03b0a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.399180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739bcb9-625e-428b-94b6-863b03b0a8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.417864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e739bcb9-625e-428b-94b6-863b03b0a8a6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:24.419065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e739bcb9-625e-428b-94b6-863b03b0a8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:24.425736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:24.427464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:24.453262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:24.492312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 456/898] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:24.515265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739bcb9-625e-428b-94b6-863b03b0a8a6 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.544090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 443/899] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:24 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:57:24.549123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.635990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739bcb9-625e-428b-94b6-863b03b0a8a6 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:24.667983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:24.675433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1dcba-3b41-48c9-83ad-53ecfa017c39 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:24.676398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:24.678049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.678482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.678933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.679762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:24.681290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:24.695328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:24.696518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:24.697520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:24.705329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:24.705783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 457/900] 10.222.0.78 () {56 vars in 1132 bytes} [Mon Jul 4 09:57:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:24.707489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.715061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:24.715905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.716186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.716459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.729862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:24.731473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:24.754725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:24.755887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:24.756925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:24.756925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:24.756925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:24.756925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:24.756925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 444/901] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:24.763122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.831306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bb6e5-8938-46f0-bbcf-095f0956d7f6 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:24.870261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:24.871201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.871774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.872205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.873191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:24.873648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:24.875166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:24.875699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cce45-4f17-46c8-be6e-8fe5b6ef241a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:24.886185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 458/902] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:24.887391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.912758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:24.913268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:24.913550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:24.913886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:24.914634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:24.915025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:24.916415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:24.932921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 445/903] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:24.934141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:24.955199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:24.972441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:25.006121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c265579-0fe5-4877-8cf6-9b2b9c6b833e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:25.044225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac5cd-d7a3-443e-9955-8d6d4324237c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:25.045137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:25.046139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.046674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.047130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.048133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:25.049175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:25.050744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:25.061811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 459/904] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:25.063023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:25.083693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:25.084502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.084782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.085055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.092502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:25.094105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:25.108677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:25.109597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:25.110511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:25.115233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 446/905] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:25.116507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:25.183253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e64b14-70df-41fb-8fcf-5538e4f73c8d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:25.216026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:25.218782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:25.226769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d9806-c8c5-49f5-9616-74d4a0bc24c0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:25.228298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:25.229474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.230118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.230726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.232058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] RBAC: Adding query filter params (interface=public, service_id=6f80c3324bda4bc29dd179dd7a03a938, region_id=RegionOne) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:25.232705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:25.234413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:25.243222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 460/906] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 09:57:25 2022] GET /identity/v3/endpoints?service_id=6f80c3324bda4bc29dd179dd7a03a938&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:25.249245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:25.271183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:25.272060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.272438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.272829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.273787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:25.274238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:25.275834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:25.295479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 447/907] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:25.296822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:25.361930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c423c7-9c5e-434c-ad15-a918f84d211a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:25.399125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722ed64-b4e3-46c2-a78d-58665bc7360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:25.400140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ed64-b4e3-46c2-a78d-58665bc7360c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.400646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ed64-b4e3-46c2-a78d-58665bc7360c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.401373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ed64-b4e3-46c2-a78d-58665bc7360c None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.402253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722ed64-b4e3-46c2-a78d-58665bc7360c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:25.403921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722ed64-b4e3-46c2-a78d-58665bc7360c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:25.408552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d8311-8bf2-4165-b4df-4a26e0a6bedb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:25.415904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 461/908] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:25 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:57:25.451887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ca8eb-8778-4892-897a-72132abb9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:25.452559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca8eb-8778-4892-897a-72132abb9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.452837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca8eb-8778-4892-897a-72132abb9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.453109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca8eb-8778-4892-897a-72132abb9ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.454025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ca8eb-8778-4892-897a-72132abb9ff1 None admin] RBAC: Adding query filter params (role.id=d66f2bedcaf84f4fa122597baf552604, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=15dfaee01d964b2d9ed52e4474a99863) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:25.454423 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ca8eb-8778-4892-897a-72132abb9ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:25.455885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ca8eb-8778-4892-897a-72132abb9ff1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:25.467844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 448/909] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:25 2022] GET /identity/v3/role_assignments?user.id=15dfaee01d964b2d9ed52e4474a99863&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=d66f2bedcaf84f4fa122597baf552604 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:25.962062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735fb83-ac22-4357-b8c5-4c5c253fb1b4 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.962454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735fb83-ac22-4357-b8c5-4c5c253fb1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.962636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735fb83-ac22-4357-b8c5-4c5c253fb1b4 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.964254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 462/910] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:25.969528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c4a0-c25f-467d-8f46-759eb5497b57 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:25.969816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c4a0-c25f-467d-8f46-759eb5497b57 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:25.970728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c4a0-c25f-467d-8f46-759eb5497b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:25.988257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ec28c4a0-c25f-467d-8f46-759eb5497b57 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:25.989454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ec28c4a0-c25f-467d-8f46-759eb5497b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:26.005610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:26.061601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 449/911] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:26.084305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735fb83-ac22-4357-b8c5-4c5c253fb1b4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:26.144481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:26.202203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78ba8-1d24-4e22-970c-80810897e766 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:26.202586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78ba8-1d24-4e22-970c-80810897e766 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:26.202764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78ba8-1d24-4e22-970c-80810897e766 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:26.204899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 450/912] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:26.207926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735fb83-ac22-4357-b8c5-4c5c253fb1b4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:26.210380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad1002-95c0-4809-94fb-c4163f033abc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:26.210771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad1002-95c0-4809-94fb-c4163f033abc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:26.211155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad1002-95c0-4809-94fb-c4163f033abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:26.233281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cfad1002-95c0-4809-94fb-c4163f033abc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:26.235186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cfad1002-95c0-4809-94fb-c4163f033abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:26.249519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:26.250794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:26.251084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:26.251949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:26.252951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:26.254652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:26.271641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:26.272968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:26.274136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 463/913] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:26.278469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:26.319696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 451/914] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:26.342249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad1002-95c0-4809-94fb-c4163f033abc None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:26.389329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94bbb7-681d-453a-aa24-cee09bb38bbd None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:26.405718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:26.430736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:26.431476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:26.432427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:26.432720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:26.433181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:26.433969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:26.434275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:26.435824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:26.446788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 464/915] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:26.448146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:26.454046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad1002-95c0-4809-94fb-c4163f033abc None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:26.490989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:26.492055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:26.492558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:26.493057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:26.494020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:26.495613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:26.512085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 452/916] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:26 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:57:26.567847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25322-088e-4953-b3b5-fbbf664734f4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:26.627975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e97ee-aa6a-45b5-afaf-d0c1dfb079c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:26.628663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e97ee-aa6a-45b5-afaf-d0c1dfb079c6 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:26.628947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e97ee-aa6a-45b5-afaf-d0c1dfb079c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:26.629223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e97ee-aa6a-45b5-afaf-d0c1dfb079c6 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:26.629952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e97ee-aa6a-45b5-afaf-d0c1dfb079c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:26.630326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e97ee-aa6a-45b5-afaf-d0c1dfb079c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:26.631879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e97ee-aa6a-45b5-afaf-d0c1dfb079c6 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:26.638251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 465/917] 10.222.0.78 () {56 vars in 1114 bytes} [Mon Jul 4 09:57:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:26.644622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:26.759414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740d4c-2111-4950-a823-f3a2cec6fd4a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:26.794621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf89011-bd23-4664-8f8a-0eab37bf580e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:26.795288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89011-bd23-4664-8f8a-0eab37bf580e None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:26.795595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89011-bd23-4664-8f8a-0eab37bf580e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:26.795874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89011-bd23-4664-8f8a-0eab37bf580e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:26.796632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf89011-bd23-4664-8f8a-0eab37bf580e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:26.798522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf89011-bd23-4664-8f8a-0eab37bf580e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:26.806907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:26.824395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 453/918] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:27.572962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4245421-71a3-421a-bd4a-a510cafe4582 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:27.573849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4245421-71a3-421a-bd4a-a510cafe4582 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:27.574300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4245421-71a3-421a-bd4a-a510cafe4582 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:27.575874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 466/919] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:27.581650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c485-20b5-432e-be8b-7c5d1210bf10 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:27.582051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c485-20b5-432e-be8b-7c5d1210bf10 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:27.582218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c485-20b5-432e-be8b-7c5d1210bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:27.602042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a7ba-a0c1-4a0e-bb34-5177d76afe62 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:27.602329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a7ba-a0c1-4a0e-bb34-5177d76afe62 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:27.602612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a7ba-a0c1-4a0e-bb34-5177d76afe62 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:27.604320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 467/920] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:27.605571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3368c485-20b5-432e-be8b-7c5d1210bf10 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:27.606769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3368c485-20b5-432e-be8b-7c5d1210bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:27.609528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405b18-5ffc-4d43-88c4-cec75fdf0fb6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:27.609817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405b18-5ffc-4d43-88c4-cec75fdf0fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:27.610094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405b18-5ffc-4d43-88c4-cec75fdf0fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:27.628155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d5405b18-5ffc-4d43-88c4-cec75fdf0fb6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:27.629428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d5405b18-5ffc-4d43-88c4-cec75fdf0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:27.667947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:27.692542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 454/921] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:27.703817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 468/922] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:27.715768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c485-20b5-432e-be8b-7c5d1210bf10 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:27.726357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405b18-5ffc-4d43-88c4-cec75fdf0fb6 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:27.827333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c485-20b5-432e-be8b-7c5d1210bf10 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:27.855161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405b18-5ffc-4d43-88c4-cec75fdf0fb6 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:27.858794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:27.875162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:27.876951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:27.877944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:27.877944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:27.878161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:27.879530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:27.896248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:27.897228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:27.898092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 455/923] 10.222.0.78 () {56 vars in 1132 bytes} [Mon Jul 4 09:57:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:27.904222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:27.904222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:27.904222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:27.904222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:27.904576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:27.917735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:27.929459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:27.930807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:27.931695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 469/924] 10.222.0.78 () {56 vars in 1120 bytes} [Mon Jul 4 09:57:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:27.934966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:27.975601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:28.028359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910162d-edec-4744-8072-05ce7799d118 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.051031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fc80e-6ec1-4907-8724-412f365e577f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.064159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.064834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.065118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.065395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.066110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:28.066419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.067809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.073065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 456/925] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:28.080600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.087269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.087973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.088257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.088535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.089285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:28.089589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.090958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.101097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 470/926] 10.222.0.78 () {56 vars in 1115 bytes} [Mon Jul 4 09:57:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:28.106216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.140878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:28.194279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9521a-53d5-40bd-8e6b-09375eff5695 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.215218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:28.227227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1fc9e-6198-4688-a6dd-18a0462e604a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.229586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.230259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.231216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.231216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.231532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:28.231874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.233247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.243614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 457/927] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:28.250433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.273367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.274597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.274892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.275168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.293203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.297043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:28.319780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:28.321238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:28.322178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:28.322178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:28.322178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:28.322178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:28.325644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 471/928] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:28.326483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.374584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89545-9685-4a45-ab3a-092249a1f405 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.390321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:28.413873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.414550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.414838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.415184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.415993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.417430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.442763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75b5fb-a862-46a7-b8b1-bc1e95c52dd7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.455735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 458/929] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:28.490311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.491269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.491745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.492174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.493050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:28.493499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.495027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.504092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:28.512059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 472/930] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:28.519688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.642711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5dea1-cd6e-4bff-b94f-0506de908828 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.680372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d50da-b10d-4d15-bc52-6a8d9a36e5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.681203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d50da-b10d-4d15-bc52-6a8d9a36e5ea None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.681483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d50da-b10d-4d15-bc52-6a8d9a36e5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.681754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d50da-b10d-4d15-bc52-6a8d9a36e5ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.691161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d50da-b10d-4d15-bc52-6a8d9a36e5ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.692623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d50da-b10d-4d15-bc52-6a8d9a36e5ea None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-228d50da-b10d-4d15-bc52-6a8d9a36e5ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:28.708370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:28.709372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:28.710322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 459/931] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 09:57:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:28.715530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.736720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e824-6400-4515-b4eb-4436f4b0155d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.736992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e824-6400-4515-b4eb-4436f4b0155d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.737282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e824-6400-4515-b4eb-4436f4b0155d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.738940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 460/932] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:28.744347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5bbc0-6228-47d4-b3c5-e60feba0b3f0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.744643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5bbc0-6228-47d4-b3c5-e60feba0b3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.744922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5bbc0-6228-47d4-b3c5-e60feba0b3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.764877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-06f5bbc0-6228-47d4-b3c5-e60feba0b3f0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:28.766213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-06f5bbc0-6228-47d4-b3c5-e60feba0b3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:28.798126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:28.837673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd75b-d662-4979-8f01-58fe22afd620 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.849179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 461/933] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:28.872150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5bbc0-6228-47d4-b3c5-e60feba0b3f0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.882549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:28.883739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:28.884022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:28.884296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:28.885566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:28.886201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:28.887929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:28.913293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 473/934] 10.222.0.78 () {56 vars in 1149 bytes} [Mon Jul 4 09:57:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:28.918943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:28.986768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5bbc0-6228-47d4-b3c5-e60feba0b3f0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:28.995641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.026404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15767726-7bb9-41cb-99eb-34f2cd2c9252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.027203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15767726-7bb9-41cb-99eb-34f2cd2c9252 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.027483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15767726-7bb9-41cb-99eb-34f2cd2c9252 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.027791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15767726-7bb9-41cb-99eb-34f2cd2c9252 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.028448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15767726-7bb9-41cb-99eb-34f2cd2c9252 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.029814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15767726-7bb9-41cb-99eb-34f2cd2c9252 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.042742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345752c-ef4d-4dd0-ba6e-f5abb7378fb2 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-15767726-7bb9-41cb-99eb-34f2cd2c9252 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:29.043211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:29.044453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:29.045852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 462/935] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:29.046706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6806-901b-4613-aef5-fb2bcdab978a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.046706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6806-901b-4613-aef5-fb2bcdab978a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.046706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6806-901b-4613-aef5-fb2bcdab978a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.047598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 463/936] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:29.052787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a6806-901b-4613-aef5-fb2bcdab978a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.080615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.090526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a8b3d-34a5-431c-ae0e-5b51fd485cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.091665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a8b3d-34a5-431c-ae0e-5b51fd485cef None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.092222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a8b3d-34a5-431c-ae0e-5b51fd485cef None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.092499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a8b3d-34a5-431c-ae0e-5b51fd485cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.103717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a8b3d-34a5-431c-ae0e-5b51fd485cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.105358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a8b3d-34a5-431c-ae0e-5b51fd485cef None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-571a8b3d-34a5-431c-ae0e-5b51fd485cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:29.124156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:29.125085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:29.126150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:29.126150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:29.126150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:29.126150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.126150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 474/937] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:29.128006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6a81-4aa2-4e12-b9da-d83bb42ddcac None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.128006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6a81-4aa2-4e12-b9da-d83bb42ddcac None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.128006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e6a81-4aa2-4e12-b9da-d83bb42ddcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.145979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b99e6a81-4aa2-4e12-b9da-d83bb42ddcac None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:29.147157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b99e6a81-4aa2-4e12-b9da-d83bb42ddcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:29.169483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a6806-901b-4613-aef5-fb2bcdab978a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.206908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.207673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.207963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.208240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.209012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:29.209286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.210667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.215623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 464/938] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:29.216408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.231642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 475/939] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:29.232317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e6a81-4aa2-4e12-b9da-d83bb42ddcac None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.276024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.333832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.342289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e6a81-4aa2-4e12-b9da-d83bb42ddcac None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.347672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aafa5-ebfa-4905-8a32-e86b2458c782 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.380727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.381485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.381772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.382097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.382855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:29.383169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.383543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.384346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.384571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.384824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.385195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.386023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:29.386536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.388023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.389521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 476/940] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:29.394522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.405514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 465/941] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:29.406513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.505056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd07434-a2e4-4b93-b9ae-e41d272e2111 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.506894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.520357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127718d1-2427-4f77-ace4-69d25b1a71f0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.546522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.547331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.547713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.548606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.549383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.550893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.552627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING keystone.server.flask.common [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 09:57:29.558009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.558671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.558954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.559228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.560228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] RBAC: Adding query filter params (interface=public, service_id=419edfaf413641a5a1800854a72016be, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:29.560549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.561959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.571873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 466/942] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/endpoints?service_id=419edfaf413641a5a1800854a72016be&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:29.572799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.575994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.sql.core [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:57:29.575994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 09:57:29.575994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [parameters: {'id': '5894e492c14349a6b4447450fe7ae857', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 09:57:29.575994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80354) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5894e492c14349a6b4447450fe7ae857.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5894e492c14349a6b4447450fe7ae857. Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:57:29.583717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result.read() Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 04 09:57:29.584531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application yield resource Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise self.value Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application session.commit() Jul 04 09:57:29.585519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:57:29.586430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:57:29.588460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application result.read() Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:57:29.590034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [parameters: {'id': '5894e492c14349a6b4447450fe7ae857', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.592318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:29.593333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5894e492c14349a6b4447450fe7ae857. Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 477/943] 10.222.0.78 () {60 vars in 1140 bytes} [Mon Jul 4 09:57:29 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:29.594495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.600434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.702343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b4ac-e213-4181-bf18-77748409f32a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.712199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a4828-b05c-43f8-a464-2bf1f3709349 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.740017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.740814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.741096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.741371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.748023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.748482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.748690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.748975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.749253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.749792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.749955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.752150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.761373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 478/944] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:57:29.762136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:29.767636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:29.768616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:29.769519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:29.772728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 467/945] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:29.778481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.791724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.889414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e7d36-98ee-44b3-858a-0a17da6aab68 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.891838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:29.935629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.936419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f6507-77f5-42b5-888a-3f291f5ec479 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:29.936554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.936774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.937054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.946807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.948679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:29.968062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:29.969007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:29.970491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:29.970944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 479/946] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:29.977300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:29.981437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:29.982217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:29.982563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:29.982907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:29.983813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:29.984189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:29.986439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:30.006140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 468/947] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:30.015663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:30.069186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:30.088287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce28dff-3638-49f2-bbeb-254d706a961d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:30.126471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23cc16-99e6-4586-9aba-9be6dd271a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:30.127352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23cc16-99e6-4586-9aba-9be6dd271a82 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:30.127831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23cc16-99e6-4586-9aba-9be6dd271a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:30.128207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23cc16-99e6-4586-9aba-9be6dd271a82 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:30.129071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23cc16-99e6-4586-9aba-9be6dd271a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:30.129476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23cc16-99e6-4586-9aba-9be6dd271a82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:30.131010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23cc16-99e6-4586-9aba-9be6dd271a82 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:30.147532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565530-ea51-4258-9f92-233000d62aa3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:30.149178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 480/948] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:30.190137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:30.195529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efdd60-156e-483e-9dc7-146d9bb7defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:30.196960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efdd60-156e-483e-9dc7-146d9bb7defa None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:30.197632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efdd60-156e-483e-9dc7-146d9bb7defa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:30.197907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efdd60-156e-483e-9dc7-146d9bb7defa None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/15dfaee01d964b2d9ed52e4474a99863/roles/d66f2bedcaf84f4fa122597baf552604` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:30.200271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efdd60-156e-483e-9dc7-146d9bb7defa None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=15dfaee01d964b2d9ed52e4474a99863, role_id=d66f2bedcaf84f4fa122597baf552604)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:30.201792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efdd60-156e-483e-9dc7-146d9bb7defa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:30.221610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 469/949] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:57:30 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/15dfaee01d964b2d9ed52e4474a99863/roles/d66f2bedcaf84f4fa122597baf552604 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:57:30.636599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5960d-d31a-4ae7-b8dc-dd67f7b37d3f None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:30.636926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5960d-d31a-4ae7-b8dc-dd67f7b37d3f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:30.637167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5960d-d31a-4ae7-b8dc-dd67f7b37d3f None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:30.638813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 481/950] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:30.644520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792da106-0812-4687-a7a9-0d4a4d0a3bb7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:30.644814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792da106-0812-4687-a7a9-0d4a4d0a3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:30.645099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792da106-0812-4687-a7a9-0d4a4d0a3bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:30.662919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-792da106-0812-4687-a7a9-0d4a4d0a3bb7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:30.664135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-792da106-0812-4687-a7a9-0d4a4d0a3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:30.737627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 470/951] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:30.761225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5960d-d31a-4ae7-b8dc-dd67f7b37d3f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:30.869469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5960d-d31a-4ae7-b8dc-dd67f7b37d3f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:30.905960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:30.906759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:30.907035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:30.907861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:30.908517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:30.909893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:30.921850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:30.925197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:30.927416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 482/952] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:30.936240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792da106-0812-4687-a7a9-0d4a4d0a3bb7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:31.039274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792da106-0812-4687-a7a9-0d4a4d0a3bb7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:31.063285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:31.075436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417faf-cb70-4e53-bbb9-bb069e83b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:31.076134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417faf-cb70-4e53-bbb9-bb069e83b79d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:31.076419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417faf-cb70-4e53-bbb9-bb069e83b79d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:31.076696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417faf-cb70-4e53-bbb9-bb069e83b79d None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:31.077424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b417faf-cb70-4e53-bbb9-bb069e83b79d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:31.077707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b417faf-cb70-4e53-bbb9-bb069e83b79d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:31.079106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b417faf-cb70-4e53-bbb9-bb069e83b79d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:31.084292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 471/953] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:31.091078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:31.102158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:31.202792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892609a-f29e-4a5e-bcc1-52e2de127ca2 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:31.237013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9cf65-bbc9-4521-9beb-aa7c85e85ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:31.237683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cf65-bbc9-4521-9beb-aa7c85e85ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:31.237962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cf65-bbc9-4521-9beb-aa7c85e85ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:31.238232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cf65-bbc9-4521-9beb-aa7c85e85ff2 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:31.238938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9cf65-bbc9-4521-9beb-aa7c85e85ff2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:31.239240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9cf65-bbc9-4521-9beb-aa7c85e85ff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:31.240626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9cf65-bbc9-4521-9beb-aa7c85e85ff2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:31.245757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 483/954] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:31.945236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabb407-f422-4ed7-8e69-6b7373d4122f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:31.945758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabb407-f422-4ed7-8e69-6b7373d4122f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:31.945758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabb407-f422-4ed7-8e69-6b7373d4122f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:31.947399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 472/955] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:31.952736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e2b2-aa1e-4edf-acfd-2d36d86baefd None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:31.953145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e2b2-aa1e-4edf-acfd-2d36d86baefd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:31.953329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e2b2-aa1e-4edf-acfd-2d36d86baefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:31.971322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-64c4e2b2-aa1e-4edf-acfd-2d36d86baefd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:31.973042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-64c4e2b2-aa1e-4edf-acfd-2d36d86baefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:32.038762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:32.043411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 484/956] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:32.067123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabb407-f422-4ed7-8e69-6b7373d4122f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.169928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabb407-f422-4ed7-8e69-6b7373d4122f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:32.208447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87105b3a-bf9c-49bf-a2c0-78f51e040a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:32.209190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87105b3a-bf9c-49bf-a2c0-78f51e040a65 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.209476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87105b3a-bf9c-49bf-a2c0-78f51e040a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.209755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87105b3a-bf9c-49bf-a2c0-78f51e040a65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.210423 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87105b3a-bf9c-49bf-a2c0-78f51e040a65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:32.211829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87105b3a-bf9c-49bf-a2c0-78f51e040a65 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-87105b3a-bf9c-49bf-a2c0-78f51e040a65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:32.225136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:32.226250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.227166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 473/957] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:32.232402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e2b2-aa1e-4edf-acfd-2d36d86baefd None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.336853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e2b2-aa1e-4edf-acfd-2d36d86baefd None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:32.354988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cb91-482d-4fe4-9caa-5b7152b33986 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.355304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cb91-482d-4fe4-9caa-5b7152b33986 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.355547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cb91-482d-4fe4-9caa-5b7152b33986 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.357338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 474/958] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:32.364653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74738b2f-5fea-478f-b7cc-08e306687036 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.364653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74738b2f-5fea-478f-b7cc-08e306687036 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.364653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74738b2f-5fea-478f-b7cc-08e306687036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.371909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee646-2175-4367-8055-b353ca102385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:32.372576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee646-2175-4367-8055-b353ca102385 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.372854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee646-2175-4367-8055-b353ca102385 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.373122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee646-2175-4367-8055-b353ca102385 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.373828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eee646-2175-4367-8055-b353ca102385 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:32.374131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eee646-2175-4367-8055-b353ca102385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:32.375489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eee646-2175-4367-8055-b353ca102385 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:32.381317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 485/959] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:32.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8de0f-6111-4664-af59-2ac124382f87 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8de0f-6111-4664-af59-2ac124382f87 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.383613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8de0f-6111-4664-af59-2ac124382f87 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.384465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 486/960] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:32.385302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-74738b2f-5fea-478f-b7cc-08e306687036 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:32.386665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-74738b2f-5fea-478f-b7cc-08e306687036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:32.387050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8de0f-6111-4664-af59-2ac124382f87 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.436536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:32.467708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 475/961] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:32.467895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:32.467980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6be7-991f-4b84-ad93-3ea0ff11e7a3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.467980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6be7-991f-4b84-ad93-3ea0ff11e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.467980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6be7-991f-4b84-ad93-3ea0ff11e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.482560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-215f6be7-991f-4b84-ad93-3ea0ff11e7a3 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:32.483804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-215f6be7-991f-4b84-ad93-3ea0ff11e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:32.514709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8de0f-6111-4664-af59-2ac124382f87 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:32.552793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:32.553789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.554293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.554766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.555793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:32.556312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:32.556734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 476/962] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:32.557714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f6be7-991f-4b84-ad93-3ea0ff11e7a3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.558488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:32.565735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 487/963] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:32.571312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.681474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d44df-af52-468b-9ade-639fa261cf62 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:32.684774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f6be7-991f-4b84-ad93-3ea0ff11e7a3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:32.696814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:32.711429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:32.720444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:32.721030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.721291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.721742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.722321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:32.723692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:32.726537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:32.727219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.727503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.727974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.728497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:32.729915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:32.731221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING keystone.server.flask.common [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 09:57:32.744149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.sql.core [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:57:32.744149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 09:57:32.744149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [parameters: {'user_id': 'a915b13e4eb649e0a84104e3db3ac2c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 09:57:32.744149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80353) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 09:57:32.746182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 488/964] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:57:32.747002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Jul 04 09:57:32.777458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:57:32.778421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application yield resource Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application next(self.gen) Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise self.value Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application session.commit() Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 09:57:32.779390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.session.flush() Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application compat.raise_( Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 09:57:32.780373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 09:57:32.781318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application conn.query(q) Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application result.read() Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 09:57:32.782206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a915b13e4eb649e0a84104e3db3ac2c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:32.786166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 04 09:57:32.788745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 04 09:57:32.791643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 04 09:57:32.791643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 04 09:57:32.791643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 09:57:32.791643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 09:57:32.791643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 09:57:32.791643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:32.791643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 477/965] 10.222.0.78 () {60 vars in 1131 bytes} [Mon Jul 4 09:57:32 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:32.793130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.894725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a72cb-6cce-4ab7-a65b-a7756e9b61f3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:32.933723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a547-41a6-451a-8d21-b9197d169054 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:32.947931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:32.949151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.949640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.950136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.968255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:32.979191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:32.980200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:32.981069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 489/966] 10.222.0.78 () {56 vars in 1120 bytes} [Mon Jul 4 09:57:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:32.981795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:32.982188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:32.982801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:32.982801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:32.990619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:32.994897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:32.996714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:33.013293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:33.014326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:33.015346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 478/967] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:33.020842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:33.040368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:33.061015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:33.118829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62af3e4-48fa-4222-935b-6e5d1d93cb43 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:33.155860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:33.156545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.156829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.157638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.158399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:33.158707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:33.160119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.163129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286b688-a05d-4f37-bbe7-aeeba8bc665f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:33.174698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 490/968] 10.222.0.78 () {56 vars in 1115 bytes} [Mon Jul 4 09:57:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:33.175678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:33.205070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:33.206355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.206494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.206736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.207561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:33.207909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:33.209462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.250630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 479/969] 10.222.0.78 () {56 vars in 1101 bytes} [Mon Jul 4 09:57:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:33.300805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bf6cc-7ff2-4e81-ba42-b52fcace9750 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:33.302831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:33.341448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96402985-7d70-450e-b959-287560c8c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:33.342279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402985-7d70-450e-b959-287560c8c08d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.342556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402985-7d70-450e-b959-287560c8c08d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.342828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402985-7d70-450e-b959-287560c8c08d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.355812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96402985-7d70-450e-b959-287560c8c08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:33.357371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96402985-7d70-450e-b959-287560c8c08d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-96402985-7d70-450e-b959-287560c8c08d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:33.377227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:33.378199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:33.379115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:33.379115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:33.379115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:33.379115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:33.379115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 491/970] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:33.384409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:33.444201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a093982-8a7d-4d33-a002-d80e76423b3e None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.444491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a093982-8a7d-4d33-a002-d80e76423b3e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.444773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a093982-8a7d-4d33-a002-d80e76423b3e None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.446273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 492/971] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:33.451232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c924-4231-43bc-b9a4-49086f1c1374 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.451518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c924-4231-43bc-b9a4-49086f1c1374 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.451827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c924-4231-43bc-b9a4-49086f1c1374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.472022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-de17c924-4231-43bc-b9a4-49086f1c1374 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:33.473233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-de17c924-4231-43bc-b9a4-49086f1c1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:33.499381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:33.511150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09377beb-cb8d-40d4-b8ea-a5fe62f2c9cd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:33.555204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:33.559021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.559021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.559021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.559021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:33.559021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:33.560031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.564300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 493/972] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:33.578784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 480/973] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:33.584768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c924-4231-43bc-b9a4-49086f1c1374 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:33.586816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:33.672601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:33.694870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c924-4231-43bc-b9a4-49086f1c1374 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:33.697682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851baf2b-0786-4f3e-b5a5-330db9ca17bd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:33.732040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:33.732850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.733028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:33.733142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.733404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.733686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.733972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.734251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.734977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:33.736902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.742553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:33.744373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.753300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 481/974] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:33 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:33.765678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:33.767386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:33.773886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 494/975] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 09:57:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:33.774522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:33.789688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:33.902237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11898-e2ab-4521-a128-d42007124be8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:33.944499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:33.945185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:33.945471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:33.945749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:33.946593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:33.946905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:33.948362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:33.966955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 482/976] 10.222.0.78 () {56 vars in 1149 bytes} [Mon Jul 4 09:57:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:33.973675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:34.078106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad402a-dc74-43e1-b044-0a2ef018fabe None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:34.112654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:34.113306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:34.113586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:34.113858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:34.129160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:34.184982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:34.186437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:34.293888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 495/977] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:33 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:57:34.295063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:34.359801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:34.399075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17d5f0-1a5b-4fa6-b85a-30134385766d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:34.434322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:34.435110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:34.435396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:34.435705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:34.446048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:34.447497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:34.466083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:34.467055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:34.473964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:34.473964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:34.473964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:34.473964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:34.473964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 483/978] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:34.476819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:34.524251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:34.589105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba349-8ca8-4a7a-8805-426d9cae8b6c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:34.624163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:34.624763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:34.625049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:34.625328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:34.626092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:34.626397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:34.627794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:34.639333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 496/979] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:34.644705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:34.753129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d052f-e26f-4c5a-aca6-425ac27f5942 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:34.770564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:34.790022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0dcd6-6c65-41d8-8f7c-70b410df89d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:34.790818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0dcd6-6c65-41d8-8f7c-70b410df89d8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:34.791105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0dcd6-6c65-41d8-8f7c-70b410df89d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:34.791384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0dcd6-6c65-41d8-8f7c-70b410df89d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:34.798661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0dcd6-6c65-41d8-8f7c-70b410df89d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:34.800142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0dcd6-6c65-41d8-8f7c-70b410df89d8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-43f0dcd6-6c65-41d8-8f7c-70b410df89d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:34.815356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:34.816443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:34.822242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 484/980] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:34.823041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:34.912577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8908-092c-4cd3-bcd1-546b3886a15d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:34.912875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8908-092c-4cd3-bcd1-546b3886a15d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:34.913052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8908-092c-4cd3-bcd1-546b3886a15d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:34.914556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 485/981] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:34.919415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4a7a-580e-4fbf-873b-b5da509f5a63 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:34.919747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4a7a-580e-4fbf-873b-b5da509f5a63 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:34.920025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4a7a-580e-4fbf-873b-b5da509f5a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:34.931216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ebc23-b931-40ae-bddd-bd1af4d43050 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:34.933592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:34.937204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d2cd4a7a-580e-4fbf-873b-b5da509f5a63 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:34.939366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d2cd4a7a-580e-4fbf-873b-b5da509f5a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:34.971720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:34.972391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:34.972668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:34.973043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:34.973826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:34.974375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:34.975617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:34.990396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 497/982] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:34.996241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:35.013882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 486/983] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:35.037195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4a7a-580e-4fbf-873b-b5da509f5a63 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:35.102751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78888ab1-817d-4f68-8af4-3dc7ad4fc3bc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:35.138897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:35.139548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.139866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.140142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.140971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] RBAC: Adding query filter params (role.id=d66f2bedcaf84f4fa122597baf552604, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=15dfaee01d964b2d9ed52e4474a99863) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:35.141778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:35.143221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:35.144841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4a7a-580e-4fbf-873b-b5da509f5a63 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:35.149018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 498/984] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:34 2022] GET /identity/v3/role_assignments?user.id=15dfaee01d964b2d9ed52e4474a99863&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=d66f2bedcaf84f4fa122597baf552604 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:35.153856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:35.186519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:35.187363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.187680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.187955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.189192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:35.190655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:35.204878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:35.206120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:35.207009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:35.211080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 487/985] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:35.212465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:35.248381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:35.330917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1f4a0-a523-4588-a663-e101567c6173 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:35.367529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:35.368285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.368574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.368850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.369560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:35.369867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:35.371238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:35.380785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 499/986] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:35.382294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:35.487970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aef8c4-94c0-45e6-a73e-24bfd9fed31f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:35.523255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:35.523953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.524238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.524515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.525229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:35.525534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:35.526891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:35.532930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 488/987] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:35.538547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:35.641028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:35.651091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda90c-7505-4fdd-9d40-c14c283ab884 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:35.686365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6583026-0c2e-4635-9443-285b8256a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:35.687026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6583026-0c2e-4635-9443-285b8256a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.687309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6583026-0c2e-4635-9443-285b8256a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.687632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6583026-0c2e-4635-9443-285b8256a1f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.688438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6583026-0c2e-4635-9443-285b8256a1f1 None admin] RBAC: Adding query filter params (interface=admin, service_id=419edfaf413641a5a1800854a72016be, region_id=RegionOne) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:35.688750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6583026-0c2e-4635-9443-285b8256a1f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:35.690111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6583026-0c2e-4635-9443-285b8256a1f1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:35.695535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 500/988] 10.222.0.78 () {56 vars in 1249 bytes} [Mon Jul 4 09:57:35 2022] GET /identity/v3/endpoints?service_id=419edfaf413641a5a1800854a72016be&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:35.700832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:35.736810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:35.804532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4489-9ccb-4e81-b388-2a0aab0cdf27 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:35.838944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6ab3-eed3-4eb5-8c42-c3a88d397efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:35.839645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6ab3-eed3-4eb5-8c42-c3a88d397efe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.839936 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6ab3-eed3-4eb5-8c42-c3a88d397efe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.840216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6ab3-eed3-4eb5-8c42-c3a88d397efe None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.840904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a6ab3-eed3-4eb5-8c42-c3a88d397efe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:35.842265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a6ab3-eed3-4eb5-8c42-c3a88d397efe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:35.848234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc62f-e001-47d6-9fd3-336a0dd5bad8 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.848527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc62f-e001-47d6-9fd3-336a0dd5bad8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.848806 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdc62f-e001-47d6-9fd3-336a0dd5bad8 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.854133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 489/989] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:35 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:57:35.854305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 501/990] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:35.855417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f465-1ede-4a16-97c3-472debc4b413 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:35.855735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f465-1ede-4a16-97c3-472debc4b413 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:35.856013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f465-1ede-4a16-97c3-472debc4b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:35.874342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cae9f465-1ede-4a16-97c3-472debc4b413 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:35.875701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cae9f465-1ede-4a16-97c3-472debc4b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:35.950581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 490/991] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:35.973401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdc62f-e001-47d6-9fd3-336a0dd5bad8 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:36.081560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdc62f-e001-47d6-9fd3-336a0dd5bad8 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:36.116281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:36.117446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:36.117733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:36.118047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:36.118722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:36.120073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:36.132545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:36.133597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:36.134481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 502/992] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:36.139527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f465-1ede-4a16-97c3-472debc4b413 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:36.168789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:36.245195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f465-1ede-4a16-97c3-472debc4b413 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:36.282867 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:36.284000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:36.284352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:36.284626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:36.285343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:36.285647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:36.287034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:36.298782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 491/993] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:36.300422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:36.339103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:36.421410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a0c6-cc54-4941-a0be-07d7b377832f None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:36.456202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:36.456874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:36.457163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:36.457443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:36.458151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:36.458461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:36.459891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:36.465004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 503/994] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:36.471079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:36.571496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:36.586065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbc1ee-f3f9-49df-9f0d-d988c7c852ee None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:36.626262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45bf5-cbc0-44b0-84f0-469e45ffd184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:36.626843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45bf5-cbc0-44b0-84f0-469e45ffd184 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:36.627132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45bf5-cbc0-44b0-84f0-469e45ffd184 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:36.627416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45bf5-cbc0-44b0-84f0-469e45ffd184 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:36.628248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45bf5-cbc0-44b0-84f0-469e45ffd184 None admin] RBAC: Adding query filter params (interface=public, service_id=e86a38cd10334cd48d15a7bf1661dc80, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:36.628569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45bf5-cbc0-44b0-84f0-469e45ffd184 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:36.629933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45bf5-cbc0-44b0-84f0-469e45ffd184 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:36.639965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 492/995] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 09:57:36 2022] GET /identity/v3/endpoints?service_id=e86a38cd10334cd48d15a7bf1661dc80&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:36.641840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:36.736958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:36.757920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33729b95-f622-4c4d-a944-e53c54f91793 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:36.791384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d512d-ff10-495a-9c2a-c8940de98bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:36.792081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d512d-ff10-495a-9c2a-c8940de98bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:36.792369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d512d-ff10-495a-9c2a-c8940de98bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:36.792651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d512d-ff10-495a-9c2a-c8940de98bf3 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:36.793344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d512d-ff10-495a-9c2a-c8940de98bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:36.794716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d512d-ff10-495a-9c2a-c8940de98bf3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:36.807619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 504/996] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:36 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 09:57:37.236317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19047b5e-c538-422b-946e-45141637f10a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:37.236739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19047b5e-c538-422b-946e-45141637f10a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:37.236852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19047b5e-c538-422b-946e-45141637f10a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:37.238259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 493/997] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:37.243683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db974-32e0-4ce9-b941-b7d014eaeca6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:37.244150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db974-32e0-4ce9-b941-b7d014eaeca6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:37.244318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db974-32e0-4ce9-b941-b7d014eaeca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:37.261701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ac7db974-32e0-4ce9-b941-b7d014eaeca6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:37.262892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ac7db974-32e0-4ce9-b941-b7d014eaeca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:37.331358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 505/998] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:37.353229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19047b5e-c538-422b-946e-45141637f10a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:37.458055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19047b5e-c538-422b-946e-45141637f10a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:37.493437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:37.494216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:37.494431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:37.494708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] PATH_INFO: `/v3/services/image` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:37.495370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:37.496758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:37.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:37.510469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:37.511442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:37.515547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 494/999] 10.222.0.78 () {56 vars in 1105 bytes} [Mon Jul 4 09:57:37 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:37.516969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db974-32e0-4ce9-b941-b7d014eaeca6 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:37.606178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:37.629177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db974-32e0-4ce9-b941-b7d014eaeca6 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:37.663545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddab00-e708-4253-93f8-338f76a85ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:37.664490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddab00-e708-4253-93f8-338f76a85ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:37.664913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddab00-e708-4253-93f8-338f76a85ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:37.665330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddab00-e708-4253-93f8-338f76a85ca4 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:37.666198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddab00-e708-4253-93f8-338f76a85ca4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:37.666655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddab00-e708-4253-93f8-338f76a85ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:37.668195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddab00-e708-4253-93f8-338f76a85ca4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:37.673433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 506/1000] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:37.679018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:37.702737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:37.786472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d791-e78f-4921-93fd-9982c7ecf70e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:37.821500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd082d-06d8-4b60-8b13-4c686d7b9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:37.822172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd082d-06d8-4b60-8b13-4c686d7b9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:37.822453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd082d-06d8-4b60-8b13-4c686d7b9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:37.822720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd082d-06d8-4b60-8b13-4c686d7b9ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:37.823420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd082d-06d8-4b60-8b13-4c686d7b9ff1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:37.823761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd082d-06d8-4b60-8b13-4c686d7b9ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:37.825186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd082d-06d8-4b60-8b13-4c686d7b9ff1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:37.835608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 495/1001] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:37.945005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d59e-eae4-4e6e-9df6-587846665841 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:37.945409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d59e-eae4-4e6e-9df6-587846665841 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:37.945592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d59e-eae4-4e6e-9df6-587846665841 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:37.947124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 507/1002] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:37.952769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf330b4-e773-4522-9ab5-f2e9b95b307f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:37.953060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf330b4-e773-4522-9ab5-f2e9b95b307f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:37.953338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf330b4-e773-4522-9ab5-f2e9b95b307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:37.971691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dcf330b4-e773-4522-9ab5-f2e9b95b307f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:37.972904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dcf330b4-e773-4522-9ab5-f2e9b95b307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:38.046161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 496/1003] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:38.070174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d59e-eae4-4e6e-9df6-587846665841 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:38.179384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d59e-eae4-4e6e-9df6-587846665841 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:38.214502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:38.215308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:38.215615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:38.215902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:38.216560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:38.217927 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:38.230424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:38.231452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:38.232329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 508/1004] 10.222.0.78 () {56 vars in 1126 bytes} [Mon Jul 4 09:57:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:38.237978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf330b4-e773-4522-9ab5-f2e9b95b307f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:38.253491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:38.345744 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf330b4-e773-4522-9ab5-f2e9b95b307f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:38.380498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:38.381171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:38.381454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:38.381729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:38.382435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:38.382742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:38.384129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:38.389158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 497/1005] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:38.395335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:38.404785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:38.499168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc45f-1fa8-43f2-ac13-37f9a408563e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:38.537443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087efdb7-9c73-4e81-a013-baa7c90c791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:38.538118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087efdb7-9c73-4e81-a013-baa7c90c791e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:38.538406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087efdb7-9c73-4e81-a013-baa7c90c791e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:38.538749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087efdb7-9c73-4e81-a013-baa7c90c791e None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:38.539471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087efdb7-9c73-4e81-a013-baa7c90c791e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:38.539812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087efdb7-9c73-4e81-a013-baa7c90c791e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:38.541191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087efdb7-9c73-4e81-a013-baa7c90c791e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:38.551358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 509/1006] 10.222.0.78 () {56 vars in 1122 bytes} [Mon Jul 4 09:57:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:38.552583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:38.648428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:38.673651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b2460-dced-45a5-874e-067b1c20d5a9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:38.710041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb02253-96e8-43a0-9d72-37efaf498212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:38.710710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02253-96e8-43a0-9d72-37efaf498212 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:38.710998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02253-96e8-43a0-9d72-37efaf498212 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:38.711278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb02253-96e8-43a0-9d72-37efaf498212 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:38.712059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb02253-96e8-43a0-9d72-37efaf498212 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:38.713424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb02253-96e8-43a0-9d72-37efaf498212 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:38.728909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 498/1007] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:57:38.869882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c97ed-3fdb-43fd-96a4-c3c9614cc936 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:38.870276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c97ed-3fdb-43fd-96a4-c3c9614cc936 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:38.870460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c97ed-3fdb-43fd-96a4-c3c9614cc936 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:38.871985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 510/1008] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:38.877722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3feba3-5d8d-4e80-910e-54b5cd148ab7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:38.878013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3feba3-5d8d-4e80-910e-54b5cd148ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:38.878300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3feba3-5d8d-4e80-910e-54b5cd148ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:38.898690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4d3feba3-5d8d-4e80-910e-54b5cd148ab7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:38.899878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4d3feba3-5d8d-4e80-910e-54b5cd148ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:38.978002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 499/1009] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:39.002461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c97ed-3fdb-43fd-96a4-c3c9614cc936 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:39.075023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:39.108684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c97ed-3fdb-43fd-96a4-c3c9614cc936 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:39.142673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:39.143475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:39.143785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:39.144088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:39.144771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:39.146145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:39.158403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:39.159396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 09:57:39.160617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:39.163647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 511/1010] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:39.165757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3feba3-5d8d-4e80-910e-54b5cd148ab7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:39.230712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:39.271514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3feba3-5d8d-4e80-910e-54b5cd148ab7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:39.306361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:39.307029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:39.307308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:39.307601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:39.308314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:39.308621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:39.309972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:39.315482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 500/1011] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:39.321345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:39.440665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bbbb3-012a-4b65-9e8b-3cf4d4a9f8e7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:39.478608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17d89-f2d1-43ae-979f-6bc02a4463f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:39.479343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17d89-f2d1-43ae-979f-6bc02a4463f4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:39.479659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17d89-f2d1-43ae-979f-6bc02a4463f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:39.479943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17d89-f2d1-43ae-979f-6bc02a4463f4 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:39.480663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b17d89-f2d1-43ae-979f-6bc02a4463f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:39.480981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b17d89-f2d1-43ae-979f-6bc02a4463f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:39.482390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b17d89-f2d1-43ae-979f-6bc02a4463f4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:39.483885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:39.494884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 512/1012] 10.222.0.78 () {56 vars in 1112 bytes} [Mon Jul 4 09:57:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:39.496625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:39.614381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519f5dd-f455-4517-9b9f-d292772fb619 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:39.642339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:39.652059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a9bdb-8bc9-40a7-bb5f-dc949e26068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:39.652733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9bdb-8bc9-40a7-bb5f-dc949e26068e None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:39.653021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9bdb-8bc9-40a7-bb5f-dc949e26068e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:39.653297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9bdb-8bc9-40a7-bb5f-dc949e26068e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:39.654042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a9bdb-8bc9-40a7-bb5f-dc949e26068e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:39.655398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a9bdb-8bc9-40a7-bb5f-dc949e26068e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:39.683618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 501/1013] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:39.961652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66e23-5449-46c9-970c-bd1c678a33d1 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:39.961982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66e23-5449-46c9-970c-bd1c678a33d1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:39.962210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66e23-5449-46c9-970c-bd1c678a33d1 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:39.964063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 513/1014] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:39.970171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5dea9-4d2b-4af3-9f40-053be17a6c8f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:39.970464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5dea9-4d2b-4af3-9f40-053be17a6c8f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:39.970743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5dea9-4d2b-4af3-9f40-053be17a6c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:39.988440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-53e5dea9-4d2b-4af3-9f40-053be17a6c8f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:39.989656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-53e5dea9-4d2b-4af3-9f40-053be17a6c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:40.068969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 502/1015] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:39 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:40.091851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a66e23-5449-46c9-970c-bd1c678a33d1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:40.201507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a66e23-5449-46c9-970c-bd1c678a33d1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:40.239128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9068d-b45e-45cd-b208-3fca688e4e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:40.239827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9068d-b45e-45cd-b208-3fca688e4e69 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:40.240180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9068d-b45e-45cd-b208-3fca688e4e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:40.240426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9068d-b45e-45cd-b208-3fca688e4e69 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:40.241305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9068d-b45e-45cd-b208-3fca688e4e69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:40.242822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9068d-b45e-45cd-b208-3fca688e4e69 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:40.260543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 514/1016] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:40 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:40.862929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccc94-14bc-41e1-a761-ae90db788365 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:40.863424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccc94-14bc-41e1-a761-ae90db788365 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:40.863424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccc94-14bc-41e1-a761-ae90db788365 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:40.864848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 503/1017] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:40.869938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146eabe-c52b-47fe-ab0f-94796833a541 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:40.870335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146eabe-c52b-47fe-ab0f-94796833a541 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:40.870510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146eabe-c52b-47fe-ab0f-94796833a541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:40.887695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1146eabe-c52b-47fe-ab0f-94796833a541 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:40.888879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1146eabe-c52b-47fe-ab0f-94796833a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:40.947187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:40.971524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 515/1018] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:40.995187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cccc94-14bc-41e1-a761-ae90db788365 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:41.096605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cccc94-14bc-41e1-a761-ae90db788365 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:41.107095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:41.134220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e933c1-3e13-4758-ac58-52e6b4bf011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:41.135194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e933c1-3e13-4758-ac58-52e6b4bf011d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:41.135654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e933c1-3e13-4758-ac58-52e6b4bf011d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:41.136078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e933c1-3e13-4758-ac58-52e6b4bf011d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:41.137419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e933c1-3e13-4758-ac58-52e6b4bf011d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:41.138986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e933c1-3e13-4758-ac58-52e6b4bf011d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:41.141093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 504/1019] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:41.146599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146eabe-c52b-47fe-ab0f-94796833a541 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:41.251137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146eabe-c52b-47fe-ab0f-94796833a541 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:41.284437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f46862-9015-4168-87be-4fdec27ee65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:41.285103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46862-9015-4168-87be-4fdec27ee65f None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:41.285385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46862-9015-4168-87be-4fdec27ee65f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:41.285659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46862-9015-4168-87be-4fdec27ee65f None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:41.286378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f46862-9015-4168-87be-4fdec27ee65f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:41.287833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f46862-9015-4168-87be-4fdec27ee65f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:41.314535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 516/1020] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:57:41 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:57:41.877761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0ca3d-e500-4d0d-add1-0eda30e3be80 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:41.878269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0ca3d-e500-4d0d-add1-0eda30e3be80 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:41.878269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0ca3d-e500-4d0d-add1-0eda30e3be80 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:41.879653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 505/1021] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:41.885011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef342c-193f-4de5-b9ab-9cd4af43bc6e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:41.885400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef342c-193f-4de5-b9ab-9cd4af43bc6e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:41.885579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef342c-193f-4de5-b9ab-9cd4af43bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:41.903341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-01ef342c-193f-4de5-b9ab-9cd4af43bc6e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:41.904578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-01ef342c-193f-4de5-b9ab-9cd4af43bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:41.935719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:41.981237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 517/1022] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:42.005814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0ca3d-e500-4d0d-add1-0eda30e3be80 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.112802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0ca3d-e500-4d0d-add1-0eda30e3be80 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.148793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.149533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.149819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.150095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.160505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:42.168732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:42.169664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:42.170581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:42.171979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 506/1023] 10.222.0.78 () {56 vars in 1120 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:42.176249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef342c-193f-4de5-b9ab-9cd4af43bc6e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.278035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef342c-193f-4de5-b9ab-9cd4af43bc6e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.313970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180178-c97f-474a-abea-6fb0972d0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.314638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180178-c97f-474a-abea-6fb0972d0436 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.314925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180178-c97f-474a-abea-6fb0972d0436 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.315203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180178-c97f-474a-abea-6fb0972d0436 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.315985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180178-c97f-474a-abea-6fb0972d0436 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:42.316299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180178-c97f-474a-abea-6fb0972d0436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:42.317670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180178-c97f-474a-abea-6fb0972d0436 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:42.331218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 518/1024] 10.222.0.78 () {56 vars in 1115 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:42.332538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.334569 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9111-a335-4c90-9167-d7095b39c1ed None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.334862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9111-a335-4c90-9167-d7095b39c1ed None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.335145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9111-a335-4c90-9167-d7095b39c1ed None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.336820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 519/1025] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:42.343639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e419-3cc8-498b-864e-e3b176944d98 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.343934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e419-3cc8-498b-864e-e3b176944d98 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.344437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e419-3cc8-498b-864e-e3b176944d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.364111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f732e419-3cc8-498b-864e-e3b176944d98 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:42.365301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f732e419-3cc8-498b-864e-e3b176944d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:42.375882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:42.391802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:42.443281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 520/1026] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:42.443969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7d45a-d6cf-4585-93c7-dfba10ceb6a0 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.466346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e419-3cc8-498b-864e-e3b176944d98 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.485121 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.485935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.486223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.486503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.500894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:42.502362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:42.522308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:42.523280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:42.529289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:42.529289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:42.529289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:42.529289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:42.529289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 507/1027] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:42.529289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.583652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e419-3cc8-498b-864e-e3b176944d98 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.620903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.621809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.622097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.622400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.623028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:42.624548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:42.636192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:42.638797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:42.639872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:42.640763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 521/1028] 10.222.0.78 () {56 vars in 1105 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:42.646843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.649962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83008a9-534b-4df2-a5f2-63ea559c3c1a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.672740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:42.686030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.686774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.687061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.687335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.688107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:42.688413 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:42.689781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:42.701302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 508/1029] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:42.706989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.752477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb886aa-5885-43c7-bc1b-744b009931f6 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.791623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.792286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.792571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.792849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.793549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] RBAC: Adding query filter params (name=image) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:42.793877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:42.795206 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:42.800147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 522/1030] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:42.805860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.822325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cd14c-725c-410e-8415-51270a218453 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.858395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.859204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.859466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.859791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.867825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:42.869554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:42.884783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:42.886223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:42.887198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 509/1031] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:42.892061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:42.899859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:42.905667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:42.917386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9265-b19e-4ec3-9364-589b614f7120 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:42.954491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:42.955075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:42.955356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:42.955652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:42.956355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] RBAC: Adding query filter params (type=image) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:42.956663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:42.958023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:42.963115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 523/1032] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:42.968779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.011628 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83ed0e-ec3d-4c79-a485-2b63a9f57c34 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.050492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.051426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.051923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.052164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.053010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:43.053322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.054750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.073845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 510/1033] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:43.079413 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.079825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fa16c-25e0-461e-9b10-f2c6b7f6c227 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.117160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.117830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.118116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.118389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.119182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] RBAC: Adding query filter params (interface=public, service_id=7cc38dc8eb30421db8275a0044ac9d1d, region_id=RegionOne) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:43.119497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.120906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.127080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 524/1034] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 09:57:42 2022] GET /identity/v3/endpoints?service_id=7cc38dc8eb30421db8275a0044ac9d1d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:43.132589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.149419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:43.159084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:43.195812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a08e6-f198-4022-bddd-a840efbfe85a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.233053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.233633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.233922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.234211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.241590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ff31-6a37-4117-8026-15777bff73fa None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.282406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6209b-5dc8-4387-9235-a769be4d1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.283084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6209b-5dc8-4387-9235-a769be4d1a34 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.283366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6209b-5dc8-4387-9235-a769be4d1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.283674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6209b-5dc8-4387-9235-a769be4d1a34 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.284368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6209b-5dc8-4387-9235-a769be4d1a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.285748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6209b-5dc8-4387-9235-a769be4d1a34 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.292649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 525/1035] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 09:57:43 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 09:57:43.313907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.315514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.401318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:43.435186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d519-f310-4e6d-b71b-31e0d1010dfd None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.435868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d519-f310-4e6d-b71b-31e0d1010dfd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.436167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d519-f310-4e6d-b71b-31e0d1010dfd None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.438671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 526/1036] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:43.443677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 511/1037] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:57:43.444912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec92ea-6453-4139-8b54-cca8f524063a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.445212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec92ea-6453-4139-8b54-cca8f524063a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.445494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec92ea-6453-4139-8b54-cca8f524063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.448868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.463719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-53ec92ea-6453-4139-8b54-cca8f524063a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:43.464926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-53ec92ea-6453-4139-8b54-cca8f524063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:43.542099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 527/1038] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:43.568220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec92ea-6453-4139-8b54-cca8f524063a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.569973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb0a57-7a90-4159-b724-be7d623003d6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.583447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:43.611741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.612547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.612828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.613102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.624054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.626044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:43.646212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:43.647264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:43.648242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:43.648242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:43.648242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:43.648242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:43.648242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 512/1039] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:43.652911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.679285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:43.692068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec92ea-6453-4139-8b54-cca8f524063a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.741795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.742592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.742874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.743145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.744500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.746363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.756097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 528/1040] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:43.757805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.771768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbad31-ae12-4d63-b423-b6918f0a6a60 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.808098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.809000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.809282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.809556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.810282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:43.810585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.811974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.824262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 513/1041] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:43.830387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:43.846420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:43.874287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deab844-1eaa-463a-96f8-b0d52cdd2d8b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.910810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.911635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.911833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.912076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.913244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.915066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:43.918250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:43.940733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f83e0-d9b3-4ecf-ae10-47e03449de82 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:43.941248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 529/1042] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:57:43 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:57:43.980886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:43.981701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:43.981987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:43.982261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:43.990686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:43.992224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:44.008723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:44.009726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:44.015634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 514/1043] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:44.018378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:44.135199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d8a3b-31ef-406e-8cde-84c6c314ac0c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:44.165010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:44.172676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec66078-41b2-4518-beb1-718e9d28845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:44.173358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec66078-41b2-4518-beb1-718e9d28845e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:44.173899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec66078-41b2-4518-beb1-718e9d28845e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:44.174407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec66078-41b2-4518-beb1-718e9d28845e None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:44.175446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec66078-41b2-4518-beb1-718e9d28845e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:44.176150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec66078-41b2-4518-beb1-718e9d28845e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:44.177545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec66078-41b2-4518-beb1-718e9d28845e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:44.191476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 530/1044] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:44.197419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:44.300691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665efe7-acfc-4a00-8369-9e87ca6b9aec None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:44.337208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593d609-1c72-4a8f-aed3-1e80a2409a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:44.337869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593d609-1c72-4a8f-aed3-1e80a2409a49 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:44.338152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593d609-1c72-4a8f-aed3-1e80a2409a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:44.338429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593d609-1c72-4a8f-aed3-1e80a2409a49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:44.339261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593d609-1c72-4a8f-aed3-1e80a2409a49 None admin] RBAC: Adding query filter params (role.id=d66f2bedcaf84f4fa122597baf552604, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3a63afc7b9514ef7b4d799b1c1538b36) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:44.339592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593d609-1c72-4a8f-aed3-1e80a2409a49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:44.341022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593d609-1c72-4a8f-aed3-1e80a2409a49 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:44.347688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 515/1045] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:44 2022] GET /identity/v3/role_assignments?user.id=3a63afc7b9514ef7b4d799b1c1538b36&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=d66f2bedcaf84f4fa122597baf552604 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:45.388836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1134-339f-4384-b6cc-160101faa5a7 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:45.389365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1134-339f-4384-b6cc-160101faa5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:45.389446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1134-339f-4384-b6cc-160101faa5a7 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:45.391389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 531/1046] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:45.398285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813df727-f527-47b9-afe1-0b618aff0bc7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:45.398741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813df727-f527-47b9-afe1-0b618aff0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:45.399125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813df727-f527-47b9-afe1-0b618aff0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:45.406286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:45.418434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-813df727-f527-47b9-afe1-0b618aff0bc7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:45.419667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-813df727-f527-47b9-afe1-0b618aff0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:45.495651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 516/1047] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:45.519628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1134-339f-4384-b6cc-160101faa5a7 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:45.632670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1134-339f-4384-b6cc-160101faa5a7 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:45.669429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:45.670143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:45.670426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:45.670702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] PATH_INFO: `/v3/services/image` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:45.671360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:45.673306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:45.685514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:45.686551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 09:57:45.687445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:45.691900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 532/1048] 10.222.0.78 () {56 vars in 1105 bytes} [Mon Jul 4 09:57:45 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:45.693362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813df727-f527-47b9-afe1-0b618aff0bc7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:45.797167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813df727-f527-47b9-afe1-0b618aff0bc7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:45.834071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:45.834742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:45.835025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:45.835302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:45.836059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:45.836368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:45.837739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:45.838966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:45.849915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:45.850348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 517/1049] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:45.908832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:45.956129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e93c8-6ab7-4f5f-81c4-40cec489092d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:45.989609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8f1b-47c7-49f5-a4d5-a85cd3ad58c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:45.990277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8f1b-47c7-49f5-a4d5-a85cd3ad58c0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:45.990563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8f1b-47c7-49f5-a4d5-a85cd3ad58c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:45.990842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8f1b-47c7-49f5-a4d5-a85cd3ad58c0 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:45.991554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f8f1b-47c7-49f5-a4d5-a85cd3ad58c0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:45.991890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f8f1b-47c7-49f5-a4d5-a85cd3ad58c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:45.993272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f8f1b-47c7-49f5-a4d5-a85cd3ad58c0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:46.003353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 533/1050] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:46.004521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.053545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b94e7-8b93-4cdd-b2e7-d44810e477c4 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.053858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b94e7-8b93-4cdd-b2e7-d44810e477c4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.054119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b94e7-8b93-4cdd-b2e7-d44810e477c4 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.055492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 534/1051] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:46.060393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97960c2-738e-4162-82d7-f6498640692b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.060674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97960c2-738e-4162-82d7-f6498640692b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.060950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97960c2-738e-4162-82d7-f6498640692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.078218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e97960c2-738e-4162-82d7-f6498640692b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:46.079379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e97960c2-738e-4162-82d7-f6498640692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:46.121640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d930a49-8828-4f5d-90c1-cca1525375f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:46.155015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 535/1052] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:46.160886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:46.161421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.161706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.161983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.162769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:46.164164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:46.179477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97960c2-738e-4162-82d7-f6498640692b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.186659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 518/1053] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 09:57:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:46.234288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:46.292352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97960c2-738e-4162-82d7-f6498640692b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:46.336856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76c041-94e5-4f9e-b1f1-1e3243ae6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:46.338502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76c041-94e5-4f9e-b1f1-1e3243ae6085 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.338502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76c041-94e5-4f9e-b1f1-1e3243ae6085 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.338502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76c041-94e5-4f9e-b1f1-1e3243ae6085 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.350538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76c041-94e5-4f9e-b1f1-1e3243ae6085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-5c76c041-94e5-4f9e-b1f1-1e3243ae6085 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:46.358322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:46.359309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:46.360822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 536/1054] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:46.368558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.407516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71c39-f946-4f77-8059-4c415ecfc53b None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.408240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71c39-f946-4f77-8059-4c415ecfc53b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.408528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71c39-f946-4f77-8059-4c415ecfc53b None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.410101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 537/1055] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:46.415202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce80e0-f8d1-444c-9500-2c2167fa9558 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.416219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce80e0-f8d1-444c-9500-2c2167fa9558 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.416219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce80e0-f8d1-444c-9500-2c2167fa9558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.432999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7cce80e0-f8d1-444c-9500-2c2167fa9558 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:46.434188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7cce80e0-f8d1-444c-9500-2c2167fa9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:46.438157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:46.490153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fca3b-920b-4947-96e0-2b6ab80767f3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:46.508918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 538/1056] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:46.526573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:46.527253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.527538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.527858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.528613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:46.528919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:46.530272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:46.533591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce80e0-f8d1-444c-9500-2c2167fa9558 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.544851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 519/1057] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:46.545974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.572546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:46.644532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce80e0-f8d1-444c-9500-2c2167fa9558 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:46.661667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35ab1-74d0-4c30-b3bf-5017fbc3650a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:46.680136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:46.684575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:46.685653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.686162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.686636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.698970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:46.700068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:46.700953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.701235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.701509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] PATH_INFO: `/v3/users/8cd56433346647e889655c78e86bb2c7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:46.710819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:46.712071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:46.713117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 539/1058] 10.222.0.78 () {56 vars in 1120 bytes} [Mon Jul 4 09:57:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:46.718221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.721293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] RBAC: Authorizing `identity:get_user(user_id=8cd56433346647e889655c78e86bb2c7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:46.722813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:46.724606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 520/1059] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:57:46 2022] GET /identity/v3/users/8cd56433346647e889655c78e86bb2c7 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:46.730357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.830590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:46.837055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8396ec-1817-479e-801e-979b21ec081b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:46.841996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb4c33-e9fe-4aa5-919e-4c4127b77c3b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:46.874517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:46.875270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.875550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.875873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.876624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:46.876931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:46.878302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:46.881507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:46.882165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:46.882455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:46.882735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:46.887369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 540/1060] 10.222.0.78 () {56 vars in 1115 bytes} [Mon Jul 4 09:57:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:46.892863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:46.937108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:46.964502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:46.965970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.001464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e5c7a-724e-4f60-a33a-f7936ca47555 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.039709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.040819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.041275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.041714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.054117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.055798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:47.073411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:47.074521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:47.075678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:47.075678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:47.075678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:47.075678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:47.079820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 541/1061] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:47.083674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:47.085565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 521/1062] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:57:47.086536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:47.095326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:47.169790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:47.192058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71927c7c-4b54-47cb-8523-b36936545750 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.197892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b924a-87e5-43e5-9ec9-a654130a3ac8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.228132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.228804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.229099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.229368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.230104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:47.230416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.231820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.238485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.239683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.240156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.240725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.242161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=653115e68a6747a2949079d1bd7254d4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.243919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.245871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 542/1063] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:47.246107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 522/1064] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/projects/653115e68a6747a2949079d1bd7254d4 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:47.252443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:47.256800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:47.330721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:47.365956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e48c62-a281-4a8a-8155-c20bfa176bc7 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.372251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42badfb5-e741-4bef-8157-7f0b749fc509 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.401350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.402153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.402441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.402979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.411155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.412444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.412907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.413287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.413575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.413850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.414856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=653115e68a6747a2949079d1bd7254d4, user.id=8cd56433346647e889655c78e86bb2c7) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:47.415682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.417106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.427922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 543/1065] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/role_assignments?user.id=8cd56433346647e889655c78e86bb2c7&scope.project.id=653115e68a6747a2949079d1bd7254d4&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:47.431754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:47.432750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:47.433723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:47.435927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 523/1066] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:47.439840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:47.564434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa161e-88cf-45ab-98fd-4b0a21410912 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.606109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.606802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.607071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.607351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.608229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:47.608545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.610150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.611906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:47.630074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 544/1067] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:47.635850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:47.638809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:47.742042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81a26-dded-4d09-bdb3-0a6a96520900 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.776410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.777214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.777499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.777770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.788981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.790439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:47.809150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:47.810084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:47.811009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:47.811009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:47.811009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:47.811009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:47.811800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 524/1068] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:47.816662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:47.923231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2e10-8ab9-4439-ae12-cb176b5170c2 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:47.958910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:47.959601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:47.959890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:47.960163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:47.960891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:47.961198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:47.962695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:47.979540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 545/1069] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:47.981331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:48.040260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:48.088168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707cb5-ae0f-4be4-9951-126dac3933cb None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:48.122150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed2f6b-37c3-4ca7-966d-aa56c9384c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:48.122966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed2f6b-37c3-4ca7-966d-aa56c9384c98 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:48.123252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed2f6b-37c3-4ca7-966d-aa56c9384c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:48.123530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed2f6b-37c3-4ca7-966d-aa56c9384c98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:48.132017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed2f6b-37c3-4ca7-966d-aa56c9384c98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:48.133487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed2f6b-37c3-4ca7-966d-aa56c9384c98 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-97ed2f6b-37c3-4ca7-966d-aa56c9384c98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:48.148899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:48.149837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:48.150749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:48.155021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 525/1070] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:48.156597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:48.214258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:48.265793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bf898-5c87-435b-8a75-7a350c3271cc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:48.271938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05c44-8643-421c-9a44-3f51449639d3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:48.272229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05c44-8643-421c-9a44-3f51449639d3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:48.272509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05c44-8643-421c-9a44-3f51449639d3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:48.275949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 526/1071] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:48.278777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c54b-2698-441c-aedb-817075b08cdf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:48.279220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c54b-2698-441c-aedb-817075b08cdf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:48.279668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c54b-2698-441c-aedb-817075b08cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:48.297381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e8e5c54b-2698-441c-aedb-817075b08cdf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:48.298785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e8e5c54b-2698-441c-aedb-817075b08cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:48.304244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:48.304915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:48.305202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:48.305481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:48.306275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:48.306589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:48.308055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:48.320336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 546/1072] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:48.326386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:48.379895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 527/1073] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:48.402083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c54b-2698-441c-aedb-817075b08cdf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:48.444275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432765-c510-48e9-b9f1-450ca431aea2 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:48.449101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:48.461768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:48.488319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:48.489143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:48.489547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:48.489721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3a63afc7b9514ef7b4d799b1c1538b36/roles/d66f2bedcaf84f4fa122597baf552604` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:48.492258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=3a63afc7b9514ef7b4d799b1c1538b36, role_id=d66f2bedcaf84f4fa122597baf552604)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:48.493696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:48.508723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 547/1074] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:57:48 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3a63afc7b9514ef7b4d799b1c1538b36/roles/d66f2bedcaf84f4fa122597baf552604 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:57:48.510629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c54b-2698-441c-aedb-817075b08cdf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:48.551878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:48.552562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:48.552848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:48.553128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:48.637360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:48.638844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:48.691438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:48.748066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 528/1075] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:57:48.754750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:48.855808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5aef-7c6f-4bf6-8a0e-dcad3ce66fb0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:48.890003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73de58-874a-43ea-8af4-471baeebed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:48.891351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73de58-874a-43ea-8af4-471baeebed25 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:48.891656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73de58-874a-43ea-8af4-471baeebed25 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:48.891931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73de58-874a-43ea-8af4-471baeebed25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:48.902128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73de58-874a-43ea-8af4-471baeebed25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:48.903589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73de58-874a-43ea-8af4-471baeebed25 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2d73de58-874a-43ea-8af4-471baeebed25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:48.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:48.922099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:48.923033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:48.923033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:48.923033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:48.923033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:48.923033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 548/1076] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:48.929505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:49.034872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10964ec-29e1-48fe-ae1b-d80be8bd808e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:49.070269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8d98b-0dee-484c-a8bb-75ce75aa4e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:49.070950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d98b-0dee-484c-a8bb-75ce75aa4e5b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:49.071241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d98b-0dee-484c-a8bb-75ce75aa4e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:49.071519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d98b-0dee-484c-a8bb-75ce75aa4e5b None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:49.072279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d98b-0dee-484c-a8bb-75ce75aa4e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:49.072592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d98b-0dee-484c-a8bb-75ce75aa4e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:49.074082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d98b-0dee-484c-a8bb-75ce75aa4e5b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:49.091923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 529/1077] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:49.500775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b312d-263b-492e-a898-cb77bab08bc4 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:49.501541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b312d-263b-492e-a898-cb77bab08bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:49.501541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b312d-263b-492e-a898-cb77bab08bc4 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:49.502711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 549/1078] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:49.508169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143975-eaa0-4ad5-ac3c-8a05034fced3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:49.508459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143975-eaa0-4ad5-ac3c-8a05034fced3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:49.508736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143975-eaa0-4ad5-ac3c-8a05034fced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:49.514722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:49.530727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-72143975-eaa0-4ad5-ac3c-8a05034fced3 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:49.532574 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-72143975-eaa0-4ad5-ac3c-8a05034fced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:49.600374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 530/1079] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:49.622639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b312d-263b-492e-a898-cb77bab08bc4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:49.649768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:49.728012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b312d-263b-492e-a898-cb77bab08bc4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:49.761952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:49.762677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:49.762963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:49.763240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:49.773989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:49.781686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:49.782644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:49.783507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 550/1080] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:49.789192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143975-eaa0-4ad5-ac3c-8a05034fced3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:49.885441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143975-eaa0-4ad5-ac3c-8a05034fced3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:49.920783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:49.921451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:49.921778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:49.922054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:49.922804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:49.923106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:49.924486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:49.926126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:49.933756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 531/1081] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:49.940416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:50.024421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:50.040481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421ef1f-8ba5-457a-bc43-05139bb2cc64 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:50.074631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:50.075513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:50.075828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:50.076109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] PATH_INFO: `/v3/users/8cd56433346647e889655c78e86bb2c7` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:50.077300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] RBAC: Authorizing `identity:get_user(user_id=8cd56433346647e889655c78e86bb2c7)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:50.079321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:50.081002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 551/1082] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:57:49 2022] GET /identity/v3/users/8cd56433346647e889655c78e86bb2c7 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:50.086914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:50.187438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf34da-d3e1-4ab1-ac78-712745596e6e None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:50.220891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfbbee-b053-485c-9bb0-6c4bc38c76aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:50.221742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbbee-b053-485c-9bb0-6c4bc38c76aa None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:50.222019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbbee-b053-485c-9bb0-6c4bc38c76aa None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:50.222288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfbbee-b053-485c-9bb0-6c4bc38c76aa None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:50.223468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfbbee-b053-485c-9bb0-6c4bc38c76aa None admin] RBAC: Authorizing `identity:get_project(project_id=653115e68a6747a2949079d1bd7254d4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:50.224941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfbbee-b053-485c-9bb0-6c4bc38c76aa None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:50.226637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 532/1083] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:57:50 2022] GET /identity/v3/projects/653115e68a6747a2949079d1bd7254d4 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:50.232440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:50.332622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1fb8-4f73-4fdb-b89a-f92292e699ec None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:50.366001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2e92-3296-41e3-b52f-e3b98ea5d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:50.366882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2e92-3296-41e3-b52f-e3b98ea5d346 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:50.367163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2e92-3296-41e3-b52f-e3b98ea5d346 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:50.367432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2e92-3296-41e3-b52f-e3b98ea5d346 None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4/users/8cd56433346647e889655c78e86bb2c7/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:50.369395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2e92-3296-41e3-b52f-e3b98ea5d346 None admin] RBAC: Authorizing `identity:create_grant(project_id=653115e68a6747a2949079d1bd7254d4, user_id=8cd56433346647e889655c78e86bb2c7, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:50.370818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2e92-3296-41e3-b52f-e3b98ea5d346 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:50.384185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 552/1084] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:57:50 2022] PUT /identity/v3/projects/653115e68a6747a2949079d1bd7254d4/users/8cd56433346647e889655c78e86bb2c7/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:57:50.560676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f957-d56d-472c-8756-ad7599b33220 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:50.561071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f957-d56d-472c-8756-ad7599b33220 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:50.561236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f957-d56d-472c-8756-ad7599b33220 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:50.562673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 533/1085] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:50.568302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3099c-fc1d-4273-a662-bca01b267801 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:50.568751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3099c-fc1d-4273-a662-bca01b267801 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:50.568934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3099c-fc1d-4273-a662-bca01b267801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:50.586052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e3b3099c-fc1d-4273-a662-bca01b267801 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:50.587168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e3b3099c-fc1d-4273-a662-bca01b267801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:50.595084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:50.657234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 553/1086] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:50.681011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f957-d56d-472c-8756-ad7599b33220 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:50.745854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:50.785208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f957-d56d-472c-8756-ad7599b33220 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:50.820629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:50.821445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:50.821731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:50.822010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:50.832306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:50.840630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:50.841755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:50.842694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 534/1087] 10.222.0.78 () {56 vars in 1120 bytes} [Mon Jul 4 09:57:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:50.847807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3099c-fc1d-4273-a662-bca01b267801 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:50.944734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3099c-fc1d-4273-a662-bca01b267801 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:50.978106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:50.978777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:50.979059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:50.979330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:50.980131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:50.980415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:50.981784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:50.990350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 554/1088] 10.222.0.78 () {56 vars in 1115 bytes} [Mon Jul 4 09:57:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:50.996038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:51.095355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70484190-6a72-4f8e-b605-aa6dac8a420a None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:51.118332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:51.129358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:51.130141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:51.130422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:51.130691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:51.141142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:51.142576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:51.159632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:51.160693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:51.161601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:51.161601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:51.161601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:51.161601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:51.161601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 535/1089] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:51.166452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:51.170181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:51.264745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a940eae-63d4-4aa2-bdb5-766eda444f6a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:51.298437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:51.299091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:51.299369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:51.299668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:51.300388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:51.300692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:51.302306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:51.314486 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 555/1090] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:51.320053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:51.419318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64d72-3b99-4cae-a68d-6890efd170b2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:51.452673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:51.454018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:51.454299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:51.454573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:51.462063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:51.463492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:57:51.478367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:51.479403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:51.480400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 536/1091] 10.222.0.78 () {56 vars in 1093 bytes} [Mon Jul 4 09:57:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:51.486025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:51.548429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:51.590269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16433b-3a11-4163-90ab-51140e1b9b4a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:51.624418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:51.625617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:51.625897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:51.626171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:51.627005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:51.627310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:51.628784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:51.645937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 556/1092] 10.222.0.78 () {56 vars in 1133 bytes} [Mon Jul 4 09:57:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:51.651666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:51.687848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:51.751903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c1f1-112e-4d93-b12e-e43bb7df6766 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:51.784424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:51.785072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:51.785355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:51.785631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:51.860360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:51.861795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:51.894611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:51.960345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 537/1093] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:57:51.965930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:52.064685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95fa6d-860b-44e6-ae60-61c3c066c298 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:52.087447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:52.099333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:52.100147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.100431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.100705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.110622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:52.112118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:57:52.129952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:52.130914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:52.131873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:57:52.131873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:57:52.131873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:57:52.131873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:52.131873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 557/1094] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:52.136788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:52.239434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5381064-5f61-4c40-83fd-0a22d6f36e53 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:52.273235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7edd-ad13-4688-a639-0bdb24c12cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:52.273893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7edd-ad13-4688-a639-0bdb24c12cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.274176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7edd-ad13-4688-a639-0bdb24c12cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.274451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7edd-ad13-4688-a639-0bdb24c12cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.275180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad7edd-ad13-4688-a639-0bdb24c12cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:52.275489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad7edd-ad13-4688-a639-0bdb24c12cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:52.276867 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad7edd-ad13-4688-a639-0bdb24c12cc2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:52.279151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:52.289639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 538/1095] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:52.295015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:52.395408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f6b41-1203-40f1-b1c3-02eecf7bac2e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:52.432925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:52.433710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.433989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.434262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.440777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:52.442213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:52.452605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a393db-f076-4e03-a218-e8636c5a5d26 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.453496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a393db-f076-4e03-a218-e8636c5a5d26 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.453845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a393db-f076-4e03-a218-e8636c5a5d26 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.455885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 539/1096] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:57:52.460872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6e719-402b-4e11-91ae-22f52829df4d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:57:52.461004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:52.462041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:57:52.463128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:57:52.463610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6e719-402b-4e11-91ae-22f52829df4d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.463610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6e719-402b-4e11-91ae-22f52829df4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.463761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 558/1097] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:57:52.468558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:52.480340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-81c6e719-402b-4e11-91ae-22f52829df4d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:52.481554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-81c6e719-402b-4e11-91ae-22f52829df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:52.512961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:52.557149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 540/1098] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:57:52.581581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6e719-402b-4e11-91ae-22f52829df4d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:52.582448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bbb9-2c6f-4684-b61d-01f09c0a2b1e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:52.618874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:52.619542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.619855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.620133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.620923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:52.621235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:52.622681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:52.640116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 559/1099] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:52.646034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:52.690279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6e719-402b-4e11-91ae-22f52829df4d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:52.715727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:52.724992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:52.725780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.726059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.726328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.736833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:57:52.739278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:57:52.744395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:57:52.745561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:57:52.746829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 541/1100] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:57:52.748812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbea9f-bc21-403c-848c-0e79ff3c8d9e None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:52.753248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:52.784392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:52.785128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.785263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.785551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.786339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] RBAC: Adding query filter params (role.id=d66f2bedcaf84f4fa122597baf552604, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3a63afc7b9514ef7b4d799b1c1538b36) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:52.786653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:52.788133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:52.793905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 560/1101] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:52 2022] GET /identity/v3/role_assignments?user.id=3a63afc7b9514ef7b4d799b1c1538b36&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=d66f2bedcaf84f4fa122597baf552604 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:52.869823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b10c5-7aff-48e3-98b1-1ce2678fdfef None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:52.906624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:52.907312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:52.907621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:52.907904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:52.908671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:52.908981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:52.910518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:52.919819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 542/1102] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:57:52.926206 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:53.029475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026319e7-413e-4d32-b91f-403f131b4d8c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:53.064646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:53.065434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:53.065718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:53.066005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] PATH_INFO: `/v3/users/8cd56433346647e889655c78e86bb2c7` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:53.067251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd56433346647e889655c78e86bb2c7)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:53.068738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:53.070406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 561/1103] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:57:52 2022] GET /identity/v3/users/8cd56433346647e889655c78e86bb2c7 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:53.076303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:53.134566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:53.192801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4344b8f-27a0-4fa2-a1af-f8373b91dbca None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:53.228686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:53.229348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:53.229636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:53.229918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:53.303276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:53.304762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:53.353775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:53.408583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 543/1104] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:57:53.414718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:53.443785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:53.523674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aa735-09b9-4b42-9457-50c14c442e11 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:53.559484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acb7a3-5402-48a9-a564-a516b45f6231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:53.560387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb7a3-5402-48a9-a564-a516b45f6231 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:53.560680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb7a3-5402-48a9-a564-a516b45f6231 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:53.560961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acb7a3-5402-48a9-a564-a516b45f6231 None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:53.562171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb7a3-5402-48a9-a564-a516b45f6231 None admin] RBAC: Authorizing `identity:get_project(project_id=653115e68a6747a2949079d1bd7254d4)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:53.563716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acb7a3-5402-48a9-a564-a516b45f6231 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:53.565456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 562/1105] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:57:53 2022] GET /identity/v3/projects/653115e68a6747a2949079d1bd7254d4 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:53.571528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:53.675451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369db241-353e-4cd1-835d-52a7da81cb4c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:53.712056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d96578-dd4f-46ab-a908-0a0d20ca5f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:53.712713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d96578-dd4f-46ab-a908-0a0d20ca5f97 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:53.712998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d96578-dd4f-46ab-a908-0a0d20ca5f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:53.713273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d96578-dd4f-46ab-a908-0a0d20ca5f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:53.714107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d96578-dd4f-46ab-a908-0a0d20ca5f97 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=653115e68a6747a2949079d1bd7254d4, user.id=8cd56433346647e889655c78e86bb2c7) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:53.714419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d96578-dd4f-46ab-a908-0a0d20ca5f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:53.715870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d96578-dd4f-46ab-a908-0a0d20ca5f97 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:53.721622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 544/1106] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:53 2022] GET /identity/v3/role_assignments?user.id=8cd56433346647e889655c78e86bb2c7&scope.project.id=653115e68a6747a2949079d1bd7254d4&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:55.757479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a970-2f28-44d8-8742-77a949bb76e1 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:55.758005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a970-2f28-44d8-8742-77a949bb76e1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:55.758115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013a970-2f28-44d8-8742-77a949bb76e1 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:55.759449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 563/1107] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:55.765033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7256b6-4a3e-4d5d-8357-cdd3f5abf92b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:55.765924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7256b6-4a3e-4d5d-8357-cdd3f5abf92b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:55.766190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7256b6-4a3e-4d5d-8357-cdd3f5abf92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:55.783182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0b7256b6-4a3e-4d5d-8357-cdd3f5abf92b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:55.784411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0b7256b6-4a3e-4d5d-8357-cdd3f5abf92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:55.791837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:55.851828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 545/1108] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:55.877105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a970-2f28-44d8-8742-77a949bb76e1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:55.969744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:55.977889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013a970-2f28-44d8-8742-77a949bb76e1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:56.010371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00c1f6-0b95-4b62-9667-45605a2fd201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:56.011150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00c1f6-0b95-4b62-9667-45605a2fd201 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:56.011435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00c1f6-0b95-4b62-9667-45605a2fd201 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:56.011742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00c1f6-0b95-4b62-9667-45605a2fd201 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:56.012920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00c1f6-0b95-4b62-9667-45605a2fd201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:56.014349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00c1f6-0b95-4b62-9667-45605a2fd201 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:56.016606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 564/1109] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:57:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:56.022376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7256b6-4a3e-4d5d-8357-cdd3f5abf92b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:56.120478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7256b6-4a3e-4d5d-8357-cdd3f5abf92b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:56.153933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad31841-ebfb-4477-8af5-1caa608c5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:56.154605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31841-ebfb-4477-8af5-1caa608c5735 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:56.154891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31841-ebfb-4477-8af5-1caa608c5735 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:56.155171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31841-ebfb-4477-8af5-1caa608c5735 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:56.156011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad31841-ebfb-4477-8af5-1caa608c5735 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:56.157455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad31841-ebfb-4477-8af5-1caa608c5735 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:56.172046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:56.178784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 546/1110] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:57:56 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:57:58.251675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a51ae-02f0-42de-8499-825f6f65ecf2 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:58.254348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a51ae-02f0-42de-8499-825f6f65ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:58.254348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a51ae-02f0-42de-8499-825f6f65ecf2 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:58.254348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 565/1111] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:57:58.259129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28706406-c48f-4795-921f-d8b42c492c00 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:58.259538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28706406-c48f-4795-921f-d8b42c492c00 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:58.259727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28706406-c48f-4795-921f-d8b42c492c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:58.276323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-28706406-c48f-4795-921f-d8b42c492c00 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:57:58.277511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-28706406-c48f-4795-921f-d8b42c492c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:57:58.342668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 547/1112] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:57:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:57:58.366478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a51ae-02f0-42de-8499-825f6f65ecf2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:58.468342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a51ae-02f0-42de-8499-825f6f65ecf2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:58.501874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:58.502649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:58.502932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:58.503204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] PATH_INFO: `/v3/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:58.504717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:58.506923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:58.508490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 566/1113] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:57:58 2022] GET /identity/v3/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:58.514286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28706406-c48f-4795-921f-d8b42c492c00 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:58.612777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28706406-c48f-4795-921f-d8b42c492c00 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:58.638229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:58.646703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:58.647557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:58.647868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:58.648138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] PATH_INFO: `/v3/users/e92fb4d151a94382888aea1a3d29007c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:58.661001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] RBAC: Authorizing `identity:get_user(user_id=e92fb4d151a94382888aea1a3d29007c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:58.662407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:58.664083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 548/1114] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:57:58 2022] GET /identity/v3/users/e92fb4d151a94382888aea1a3d29007c => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:58.669807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:58.699964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:58.767647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997928-1432-486c-ba61-8acd298bbe06 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:58.799594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:58.800249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:58.800782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:58.801062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:58.867607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:58.869133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:58.899733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:58.971964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 567/1115] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:57:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:57:58.977901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:59.076230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7efd6-7ff6-4e9e-acca-53aa6dfe6cbe None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:59.109608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec47bee-68c9-4da4-9605-2cbd454ace76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:59.110466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47bee-68c9-4da4-9605-2cbd454ace76 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:59.110752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47bee-68c9-4da4-9605-2cbd454ace76 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:59.111032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47bee-68c9-4da4-9605-2cbd454ace76 None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:59.112225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec47bee-68c9-4da4-9605-2cbd454ace76 None admin] RBAC: Authorizing `identity:get_project(project_id=653115e68a6747a2949079d1bd7254d4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:59.113651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec47bee-68c9-4da4-9605-2cbd454ace76 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:59.115341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 549/1116] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:57:58 2022] GET /identity/v3/projects/653115e68a6747a2949079d1bd7254d4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:57:59.121358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:57:59.215759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e5f72-1e75-48d0-9fe5-f2f8eda9ba51 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:57:59.247330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:57:59.257399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8b021-dc8a-4d17-a9dc-372b512be2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:57:59.258040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b021-dc8a-4d17-a9dc-372b512be2df None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:57:59.258351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b021-dc8a-4d17-a9dc-372b512be2df None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:57:59.258625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b021-dc8a-4d17-a9dc-372b512be2df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:57:59.259450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8b021-dc8a-4d17-a9dc-372b512be2df None admin] RBAC: Adding query filter params (role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=653115e68a6747a2949079d1bd7254d4, user.id=e92fb4d151a94382888aea1a3d29007c) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:57:59.259788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8b021-dc8a-4d17-a9dc-372b512be2df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:57:59.261245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8b021-dc8a-4d17-a9dc-372b512be2df None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:57:59.266858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 568/1117] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:57:59 2022] GET /identity/v3/role_assignments?user.id=e92fb4d151a94382888aea1a3d29007c&scope.project.id=653115e68a6747a2949079d1bd7254d4&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:01.277817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e433c6-caab-4c25-aa53-00e7436e3d78 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:01.278381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e433c6-caab-4c25-aa53-00e7436e3d78 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:01.278381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e433c6-caab-4c25-aa53-00e7436e3d78 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:01.279769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 550/1118] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:58:01.285612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6a01-2c65-4bb5-8be9-ce7206d9401a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:01.286057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6a01-2c65-4bb5-8be9-ce7206d9401a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:01.286200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de6a01-2c65-4bb5-8be9-ce7206d9401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:01.302827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d0de6a01-2c65-4bb5-8be9-ce7206d9401a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:01.304162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d0de6a01-2c65-4bb5-8be9-ce7206d9401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:01.369279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 569/1119] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:01.392556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e433c6-caab-4c25-aa53-00e7436e3d78 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:01.449318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:01.494022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e433c6-caab-4c25-aa53-00e7436e3d78 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:01.526785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:01.527660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:01.527991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:01.528216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] PATH_INFO: `/v3/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:01.529667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:01.531090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:01.532475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 551/1120] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:01 2022] GET /identity/v3/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:01.538221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de6a01-2c65-4bb5-8be9-ce7206d9401a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:01.639355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de6a01-2c65-4bb5-8be9-ce7206d9401a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:01.663275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:01.674557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:01.675422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:01.675987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:01.676260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] PATH_INFO: `/v3/users/e92fb4d151a94382888aea1a3d29007c` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:01.677456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] RBAC: Authorizing `identity:get_user(user_id=e92fb4d151a94382888aea1a3d29007c)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:01.678889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:01.680558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 570/1121] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:01 2022] GET /identity/v3/users/e92fb4d151a94382888aea1a3d29007c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:01.686498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:01.786843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa1f13-2a18-42fa-b145-b6c9398358d5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:01.808442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:01.820756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8da8-57f5-40b2-b8b7-2390986b2307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:01.821620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8da8-57f5-40b2-b8b7-2390986b2307 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:01.821906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8da8-57f5-40b2-b8b7-2390986b2307 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:01.822182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8da8-57f5-40b2-b8b7-2390986b2307 None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:01.823358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8da8-57f5-40b2-b8b7-2390986b2307 None admin] RBAC: Authorizing `identity:get_project(project_id=653115e68a6747a2949079d1bd7254d4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:01.824826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8da8-57f5-40b2-b8b7-2390986b2307 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:01.826514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 552/1122] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:01 2022] GET /identity/v3/projects/653115e68a6747a2949079d1bd7254d4 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:01.833804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:01.934917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bcc3-83ee-4b40-94f0-841dc3eecb53 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:01.970843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddcb38-f751-491e-a882-0606a74df69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:01.971760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddcb38-f751-491e-a882-0606a74df69d None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:01.972044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddcb38-f751-491e-a882-0606a74df69d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:01.972319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddcb38-f751-491e-a882-0606a74df69d None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4/users/e92fb4d151a94382888aea1a3d29007c/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:01.974519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddcb38-f751-491e-a882-0606a74df69d None admin] RBAC: Authorizing `identity:create_grant(project_id=653115e68a6747a2949079d1bd7254d4, user_id=e92fb4d151a94382888aea1a3d29007c, role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:01.975983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddcb38-f751-491e-a882-0606a74df69d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:01.989886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 571/1123] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:58:01 2022] PUT /identity/v3/projects/653115e68a6747a2949079d1bd7254d4/users/e92fb4d151a94382888aea1a3d29007c/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:58:04.032536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50e3a-8632-45ed-8444-13665052e3f1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:04.033102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50e3a-8632-45ed-8444-13665052e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:04.033102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50e3a-8632-45ed-8444-13665052e3f1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:04.034457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 553/1124] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:04.039555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b6927-9920-492f-a3fa-60a46a2461ce None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:04.039955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b6927-9920-492f-a3fa-60a46a2461ce None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:04.040126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b6927-9920-492f-a3fa-60a46a2461ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:04.056587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7c4b6927-9920-492f-a3fa-60a46a2461ce None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:04.057761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7c4b6927-9920-492f-a3fa-60a46a2461ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:04.103266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:04.123774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 572/1125] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:04.147050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d50e3a-8632-45ed-8444-13665052e3f1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:04.247677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d50e3a-8632-45ed-8444-13665052e3f1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:04.280008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:04.281396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:04.281669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:04.281935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] PATH_INFO: `/v3/roles/c6e9495f2c5d45368c40e75d82bd58c0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:04.283451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e9495f2c5d45368c40e75d82bd58c0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:04.284761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:04.286116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 554/1126] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:04 2022] GET /identity/v3/roles/c6e9495f2c5d45368c40e75d82bd58c0 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:04.291892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b6927-9920-492f-a3fa-60a46a2461ce None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:04.385771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b6927-9920-492f-a3fa-60a46a2461ce None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:04.418879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:04.419764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:04.420047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:04.420318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] PATH_INFO: `/v3/users/e92fb4d151a94382888aea1a3d29007c` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:04.422012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] RBAC: Authorizing `identity:get_user(user_id=e92fb4d151a94382888aea1a3d29007c)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:04.423437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:04.425085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 573/1127] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:04 2022] GET /identity/v3/users/e92fb4d151a94382888aea1a3d29007c => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:04.430946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:04.487988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:04.528918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efd019-36d1-4b2b-8b94-6ff9c5aae336 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:04.562339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:04.562919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:04.563197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:04.563466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:04.629603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:04.631033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:04.685482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:04.729302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 555/1128] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:58:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:58:04.736584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:04.785668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:04.834888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577a782-50a0-4785-b42c-070f963ca9cd None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:04.867903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef794e-542b-4f6d-99ba-8de28eee0a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:04.868760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef794e-542b-4f6d-99ba-8de28eee0a49 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:04.869041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef794e-542b-4f6d-99ba-8de28eee0a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:04.869371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef794e-542b-4f6d-99ba-8de28eee0a49 None admin] PATH_INFO: `/v3/projects/653115e68a6747a2949079d1bd7254d4` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:04.870563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef794e-542b-4f6d-99ba-8de28eee0a49 None admin] RBAC: Authorizing `identity:get_project(project_id=653115e68a6747a2949079d1bd7254d4)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:04.872032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef794e-542b-4f6d-99ba-8de28eee0a49 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:04.873739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 574/1129] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:04 2022] GET /identity/v3/projects/653115e68a6747a2949079d1bd7254d4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:58:04.880355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:04.977817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40af8e3-3f30-467f-bd6b-3ad3972bd75d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:05.011105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bbab-614f-49c2-8f5f-3d991ac71e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:05.011770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bbab-614f-49c2-8f5f-3d991ac71e9c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:05.012055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bbab-614f-49c2-8f5f-3d991ac71e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:05.012332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bbab-614f-49c2-8f5f-3d991ac71e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:05.013153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bbab-614f-49c2-8f5f-3d991ac71e9c None admin] RBAC: Adding query filter params (role.id=c6e9495f2c5d45368c40e75d82bd58c0, scope.project.id=653115e68a6747a2949079d1bd7254d4, user.id=e92fb4d151a94382888aea1a3d29007c) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:05.013471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bbab-614f-49c2-8f5f-3d991ac71e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:05.014887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bbab-614f-49c2-8f5f-3d991ac71e9c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:05.020555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 556/1130] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:58:04 2022] GET /identity/v3/role_assignments?user.id=e92fb4d151a94382888aea1a3d29007c&scope.project.id=653115e68a6747a2949079d1bd7254d4&role.id=c6e9495f2c5d45368c40e75d82bd58c0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:07.068845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89daf-b41e-459c-b728-ec28781a238e None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:07.069398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89daf-b41e-459c-b728-ec28781a238e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:07.069398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89daf-b41e-459c-b728-ec28781a238e None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:07.070781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 575/1131] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:07.075839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a6c6d-b58c-432a-8119-5ea46562c030 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:07.076285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a6c6d-b58c-432a-8119-5ea46562c030 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:07.076401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a6c6d-b58c-432a-8119-5ea46562c030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:07.094163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e58a6c6d-b58c-432a-8119-5ea46562c030 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:07.095336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e58a6c6d-b58c-432a-8119-5ea46562c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:07.111256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:07.161185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 557/1132] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:07.185341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b89daf-b41e-459c-b728-ec28781a238e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:07.292067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b89daf-b41e-459c-b728-ec28781a238e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:07.308943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:07.325525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58759a-49c3-4637-bad7-bebc3c52751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:07.326260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58759a-49c3-4637-bad7-bebc3c52751e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:07.326545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58759a-49c3-4637-bad7-bebc3c52751e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:07.326822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58759a-49c3-4637-bad7-bebc3c52751e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:07.328646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58759a-49c3-4637-bad7-bebc3c52751e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:07.330081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58759a-49c3-4637-bad7-bebc3c52751e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:07.331731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 576/1133] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:58:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:07.337673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a6c6d-b58c-432a-8119-5ea46562c030 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:07.433037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a6c6d-b58c-432a-8119-5ea46562c030 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:07.465761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1412cf-dc12-45f2-af54-178a078f166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:07.466412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1412cf-dc12-45f2-af54-178a078f166f None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:07.466692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1412cf-dc12-45f2-af54-178a078f166f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:07.466967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1412cf-dc12-45f2-af54-178a078f166f None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:07.467717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1412cf-dc12-45f2-af54-178a078f166f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:07.469146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1412cf-dc12-45f2-af54-178a078f166f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:07.494899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 558/1134] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:58:07 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:58:09.562518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96284-9fbe-4f51-94e0-80f660c1f8b3 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:09.563069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96284-9fbe-4f51-94e0-80f660c1f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:09.563069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96284-9fbe-4f51-94e0-80f660c1f8b3 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:09.564514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 577/1135] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:09.569741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0db53-0aee-41ec-a9e7-c2c81586bcf9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:09.570157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0db53-0aee-41ec-a9e7-c2c81586bcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:09.570292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0db53-0aee-41ec-a9e7-c2c81586bcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:09.577698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:09.588694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7fe0db53-0aee-41ec-a9e7-c2c81586bcf9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:09.589891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7fe0db53-0aee-41ec-a9e7-c2c81586bcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:09.655886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 559/1136] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:09.681272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96284-9fbe-4f51-94e0-80f660c1f8b3 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:09.780784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96284-9fbe-4f51-94e0-80f660c1f8b3 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:09.815804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d2b9e-96eb-4d04-963f-5377bd7cf714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:09.816525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2b9e-96eb-4d04-963f-5377bd7cf714 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:09.816809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2b9e-96eb-4d04-963f-5377bd7cf714 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:09.817088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2b9e-96eb-4d04-963f-5377bd7cf714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:09.818263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d2b9e-96eb-4d04-963f-5377bd7cf714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:09.819729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d2b9e-96eb-4d04-963f-5377bd7cf714 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:09.821349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 578/1137] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:09.827324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0db53-0aee-41ec-a9e7-c2c81586bcf9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:09.923322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0db53-0aee-41ec-a9e7-c2c81586bcf9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:09.956278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92152464-3b14-4a27-8a3e-0d1170ac7f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:09.956942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152464-3b14-4a27-8a3e-0d1170ac7f32 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:09.957226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152464-3b14-4a27-8a3e-0d1170ac7f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:09.957503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92152464-3b14-4a27-8a3e-0d1170ac7f32 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:09.958202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92152464-3b14-4a27-8a3e-0d1170ac7f32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:09.959809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92152464-3b14-4a27-8a3e-0d1170ac7f32 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:09.966319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:09.979780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 560/1138] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:58:09 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:58:12.028939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb7ddf-7e3e-4dfc-a300-433139ea584c None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:12.029474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb7ddf-7e3e-4dfc-a300-433139ea584c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:12.029474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb7ddf-7e3e-4dfc-a300-433139ea584c None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:12.030899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 579/1139] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:12.036046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7adb-e819-4781-a0ad-6a0f33de3c27 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:12.036453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7adb-e819-4781-a0ad-6a0f33de3c27 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:12.036604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7adb-e819-4781-a0ad-6a0f33de3c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:12.053991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-688f7adb-e819-4781-a0ad-6a0f33de3c27 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:12.055185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-688f7adb-e819-4781-a0ad-6a0f33de3c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:12.121263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 561/1140] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:12.144436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb7ddf-7e3e-4dfc-a300-433139ea584c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:12.201339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:12.245613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb7ddf-7e3e-4dfc-a300-433139ea584c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:12.279073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:12.279829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:12.280111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:12.280386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:12.290155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:58:12.297657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:58:12.298838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:58:12.300124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 580/1141] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:58:12.305090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7adb-e819-4781-a0ad-6a0f33de3c27 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:12.400924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7adb-e819-4781-a0ad-6a0f33de3c27 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:12.420259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:12.438851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:12.439526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:12.439847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:12.440127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:12.440879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:12.441191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:12.442574 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:12.451010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 562/1142] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:58:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:12.457380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:12.557657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9da5-649e-4d4f-8cb6-6bffe82d56d1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:12.571072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:12.591870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:12.593286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:12.593568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:12.593841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] PATH_INFO: `/v3/users/7e74af0941054b6889a77b8085dee96a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:12.606799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] RBAC: Authorizing `identity:get_user(user_id=7e74af0941054b6889a77b8085dee96a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:12.608305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:12.609968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 581/1143] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:12 2022] GET /identity/v3/users/7e74af0941054b6889a77b8085dee96a => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:12.615875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:12.714400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71c21e-a155-4eef-99c5-e787f63597d9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:12.747296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:12.747965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:12.748253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:12.748617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:12.798227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:12.816886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:12.818263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:12.914598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 563/1144] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:58:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:58:12.921186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:13.016633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a7fa4-a1f4-4334-9aa1-98cc55b6ebc1 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:13.050045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6b18-8dfb-41a6-8dda-249f6e359d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:13.051152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6b18-8dfb-41a6-8dda-249f6e359d96 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:13.051437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6b18-8dfb-41a6-8dda-249f6e359d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:13.051745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6b18-8dfb-41a6-8dda-249f6e359d96 None admin] PATH_INFO: `/v3/projects/049157b6fb264ef494b5de26476d15d5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:13.052931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6b18-8dfb-41a6-8dda-249f6e359d96 None admin] RBAC: Authorizing `identity:get_project(project_id=049157b6fb264ef494b5de26476d15d5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:13.054380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6b18-8dfb-41a6-8dda-249f6e359d96 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:13.056080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 582/1145] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:12 2022] GET /identity/v3/projects/049157b6fb264ef494b5de26476d15d5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:13.063186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:13.141920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:13.160496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee46b-563b-4e79-82fc-b79efc0834e2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:13.193912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d939427-4767-4477-925d-48b47bb54d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:13.194550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939427-4767-4477-925d-48b47bb54d24 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:13.194829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939427-4767-4477-925d-48b47bb54d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:13.195100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d939427-4767-4477-925d-48b47bb54d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:13.196304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939427-4767-4477-925d-48b47bb54d24 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=049157b6fb264ef494b5de26476d15d5, user.id=7e74af0941054b6889a77b8085dee96a) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:13.196445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939427-4767-4477-925d-48b47bb54d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:13.197754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d939427-4767-4477-925d-48b47bb54d24 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:13.203591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 564/1146] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:58:13 2022] GET /identity/v3/role_assignments?user.id=7e74af0941054b6889a77b8085dee96a&scope.project.id=049157b6fb264ef494b5de26476d15d5&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:15.225292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203da5a-38e0-4485-8420-8213a3b2135a None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:15.225874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203da5a-38e0-4485-8420-8213a3b2135a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:15.225874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203da5a-38e0-4485-8420-8213a3b2135a None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:15.227217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 583/1147] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 09:58:15.232399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80cae-ead2-4eab-b33a-c96b5f5838bb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:15.232845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80cae-ead2-4eab-b33a-c96b5f5838bb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:15.233001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80cae-ead2-4eab-b33a-c96b5f5838bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:15.250063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dac80cae-ead2-4eab-b33a-c96b5f5838bb None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:15.251269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dac80cae-ead2-4eab-b33a-c96b5f5838bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:15.318019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 565/1148] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:15.340738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203da5a-38e0-4485-8420-8213a3b2135a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:15.383046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:15.441383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203da5a-38e0-4485-8420-8213a3b2135a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:15.474180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:15.474993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:15.475280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:15.475632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:15.485986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:58:15.493613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:58:15.494730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:58:15.496004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 584/1149] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:58:15.501469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80cae-ead2-4eab-b33a-c96b5f5838bb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:15.576113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:15.603048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80cae-ead2-4eab-b33a-c96b5f5838bb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:15.636256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:15.636922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:15.637208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:15.637481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:15.638220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:15.638525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:15.640437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:15.648303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 566/1150] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:15.654227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:15.749528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:15.752582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0d8b-c262-4d40-a853-ebd8138674f7 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:15.786426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:15.787298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:15.787609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:15.787882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] PATH_INFO: `/v3/users/7e74af0941054b6889a77b8085dee96a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:15.789062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] RBAC: Authorizing `identity:get_user(user_id=7e74af0941054b6889a77b8085dee96a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:15.790495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:15.792169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 585/1151] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:15 2022] GET /identity/v3/users/7e74af0941054b6889a77b8085dee96a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:15.798477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:15.898908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366c195-2bbc-4a7e-b70d-dae2f1bc058c None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:15.932869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d57b9-9804-49a1-b568-c8dcea390cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:15.933715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d57b9-9804-49a1-b568-c8dcea390cea None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:15.934002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d57b9-9804-49a1-b568-c8dcea390cea None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:15.934280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d57b9-9804-49a1-b568-c8dcea390cea None admin] PATH_INFO: `/v3/projects/049157b6fb264ef494b5de26476d15d5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:15.935451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d57b9-9804-49a1-b568-c8dcea390cea None admin] RBAC: Authorizing `identity:get_project(project_id=049157b6fb264ef494b5de26476d15d5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:15.936943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d57b9-9804-49a1-b568-c8dcea390cea None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:15.938624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 567/1152] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:15 2022] GET /identity/v3/projects/049157b6fb264ef494b5de26476d15d5 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:15.944495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:16.041594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52835186-979b-42ab-9e72-9737c8d4acef None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:16.073758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001de2cd-f6cc-41c4-9f08-29938c7a204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:16.074615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de2cd-f6cc-41c4-9f08-29938c7a204a None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:16.074894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de2cd-f6cc-41c4-9f08-29938c7a204a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:16.075166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de2cd-f6cc-41c4-9f08-29938c7a204a None admin] PATH_INFO: `/v3/projects/049157b6fb264ef494b5de26476d15d5/users/7e74af0941054b6889a77b8085dee96a/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:16.077162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001de2cd-f6cc-41c4-9f08-29938c7a204a None admin] RBAC: Authorizing `identity:create_grant(project_id=049157b6fb264ef494b5de26476d15d5, user_id=7e74af0941054b6889a77b8085dee96a, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:16.078579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001de2cd-f6cc-41c4-9f08-29938c7a204a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:16.091423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 586/1153] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:58:15 2022] PUT /identity/v3/projects/049157b6fb264ef494b5de26476d15d5/users/7e74af0941054b6889a77b8085dee96a/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:58:18.075763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b19e78-1cd7-462f-b9b0-f27d20d9408b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:18.076325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b19e78-1cd7-462f-b9b0-f27d20d9408b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:18.076325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b19e78-1cd7-462f-b9b0-f27d20d9408b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:18.077697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 568/1154] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:18.082816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f42c90-e95b-448c-9e6f-23dab09e4f9e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:18.083203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f42c90-e95b-448c-9e6f-23dab09e4f9e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:18.083363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f42c90-e95b-448c-9e6f-23dab09e4f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:18.100456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-16f42c90-e95b-448c-9e6f-23dab09e4f9e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:18.101648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-16f42c90-e95b-448c-9e6f-23dab09e4f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:18.124078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:18.169063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 587/1155] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:18.193660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b19e78-1cd7-462f-b9b0-f27d20d9408b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:18.202671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:18.296453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b19e78-1cd7-462f-b9b0-f27d20d9408b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:18.330556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:18.331282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:18.331566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:18.331871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:18.341774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:58:18.349588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:58:18.350721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:58:18.351884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 569/1156] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:58:18.356855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f42c90-e95b-448c-9e6f-23dab09e4f9e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:18.450870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f42c90-e95b-448c-9e6f-23dab09e4f9e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:18.483943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:18.484587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:18.484863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:18.485132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:18.485871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:18.486172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:18.487523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:18.495337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 588/1157] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:18.501669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:18.568728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:18.605435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18af78f-f2ca-4aca-b3fb-af2a60016c52 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:18.637597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:18.638464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:18.639254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:18.639522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] PATH_INFO: `/v3/users/7e74af0941054b6889a77b8085dee96a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:18.640754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] RBAC: Authorizing `identity:get_user(user_id=7e74af0941054b6889a77b8085dee96a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:18.642184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:18.643864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 570/1158] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:18 2022] GET /identity/v3/users/7e74af0941054b6889a77b8085dee96a => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:18.649589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:18.671721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:18.749092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be102-c630-452d-b64d-7d6bd091e0bd None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:18.782105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:18.782744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:18.783029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:18.783309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:18.850391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:18.851979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:18.871454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:18.952780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 589/1159] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:58:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:58:18.958618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:19.056425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa28a2-a895-4a6b-8d5b-ec8eab801134 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:19.088491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280782-15dc-447b-8437-3534d86ee51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:19.089348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280782-15dc-447b-8437-3534d86ee51a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:19.089630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280782-15dc-447b-8437-3534d86ee51a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:19.089904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280782-15dc-447b-8437-3534d86ee51a None admin] PATH_INFO: `/v3/projects/049157b6fb264ef494b5de26476d15d5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:19.091078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280782-15dc-447b-8437-3534d86ee51a None admin] RBAC: Authorizing `identity:get_project(project_id=049157b6fb264ef494b5de26476d15d5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:19.093063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280782-15dc-447b-8437-3534d86ee51a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:19.094746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 571/1160] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:18 2022] GET /identity/v3/projects/049157b6fb264ef494b5de26476d15d5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:19.100930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:19.198190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649a28e-06eb-467b-a016-3f3747712a50 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:19.218643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:19.233110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c155e0-0c05-4940-ae63-0584c2d36852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:19.233761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c155e0-0c05-4940-ae63-0584c2d36852 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:19.234041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c155e0-0c05-4940-ae63-0584c2d36852 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:19.234320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c155e0-0c05-4940-ae63-0584c2d36852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:19.235154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c155e0-0c05-4940-ae63-0584c2d36852 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=049157b6fb264ef494b5de26476d15d5, user.id=7e74af0941054b6889a77b8085dee96a) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:19.235468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c155e0-0c05-4940-ae63-0584c2d36852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:19.236935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c155e0-0c05-4940-ae63-0584c2d36852 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:19.242663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 590/1161] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:58:19 2022] GET /identity/v3/role_assignments?user.id=7e74af0941054b6889a77b8085dee96a&scope.project.id=049157b6fb264ef494b5de26476d15d5&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:21.257364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1f47-0c30-4bbf-a7ad-e671ff791177 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:21.257938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1f47-0c30-4bbf-a7ad-e671ff791177 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:21.257938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad1f47-0c30-4bbf-a7ad-e671ff791177 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:21.259332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 572/1162] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:21.265102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca1901-46ec-482d-b7a9-0cff36cd1490 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:21.265530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca1901-46ec-482d-b7a9-0cff36cd1490 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:21.265638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca1901-46ec-482d-b7a9-0cff36cd1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:21.282397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c4ca1901-46ec-482d-b7a9-0cff36cd1490 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:21.283566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c4ca1901-46ec-482d-b7a9-0cff36cd1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:21.348863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 591/1163] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:58:21.370892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1f47-0c30-4bbf-a7ad-e671ff791177 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:21.374307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:21.472600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad1f47-0c30-4bbf-a7ad-e671ff791177 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:21.506238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:21.506881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:21.507162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:21.507487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:21.573781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:21.575252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:21.577658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:21.673873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 573/1164] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:58:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:58:21.680068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca1901-46ec-482d-b7a9-0cff36cd1490 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:21.774113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca1901-46ec-482d-b7a9-0cff36cd1490 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:21.787816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:21.807599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1202-e1af-4405-9a01-5f8bd6d6ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:21.808393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1202-e1af-4405-9a01-5f8bd6d6ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:21.808670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1202-e1af-4405-9a01-5f8bd6d6ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:21.808942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1202-e1af-4405-9a01-5f8bd6d6ecc2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:21.816056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1202-e1af-4405-9a01-5f8bd6d6ecc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:21.817480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1202-e1af-4405-9a01-5f8bd6d6ecc2 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-ba2d1202-e1af-4405-9a01-5f8bd6d6ecc2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:58:21.831788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:58:21.833031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:58:21.834274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 592/1165] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 09:58:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:58:21.838857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:21.934984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34b97b-7e6c-445d-bc80-5d80180e6b3b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:21.937011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:21.970336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17e9a-ca7e-4099-88e0-72d810ba1a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:21.970992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17e9a-ca7e-4099-88e0-72d810ba1a86 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:21.971277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17e9a-ca7e-4099-88e0-72d810ba1a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:21.971553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17e9a-ca7e-4099-88e0-72d810ba1a86 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:21.972315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17e9a-ca7e-4099-88e0-72d810ba1a86 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:21.972626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17e9a-ca7e-4099-88e0-72d810ba1a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:21.973983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17e9a-ca7e-4099-88e0-72d810ba1a86 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:21.981058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 574/1166] 10.222.0.78 () {56 vars in 1115 bytes} [Mon Jul 4 09:58:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:24.006219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0e195-dec9-4605-99b6-8873dae14f16 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:24.006759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0e195-dec9-4605-99b6-8873dae14f16 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:24.006759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0e195-dec9-4605-99b6-8873dae14f16 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:24.008164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 593/1167] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:24.013187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ec55-ba92-4c60-aac2-e4e59c1a73cf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:24.014181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ec55-ba92-4c60-aac2-e4e59c1a73cf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:24.014272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ec55-ba92-4c60-aac2-e4e59c1a73cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:24.031206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d9d6ec55-ba92-4c60-aac2-e4e59c1a73cf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:24.032421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d9d6ec55-ba92-4c60-aac2-e4e59c1a73cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:24.098246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 575/1168] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:24.120536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0e195-dec9-4605-99b6-8873dae14f16 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:24.221824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0e195-dec9-4605-99b6-8873dae14f16 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:24.254534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc77f-177a-419c-84ed-b62470fa006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:24.255193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc77f-177a-419c-84ed-b62470fa006a None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:24.255474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc77f-177a-419c-84ed-b62470fa006a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:24.255777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc77f-177a-419c-84ed-b62470fa006a None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:24.256578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbc77f-177a-419c-84ed-b62470fa006a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:24.257903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbc77f-177a-419c-84ed-b62470fa006a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:24.272169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 594/1169] 10.222.0.78 () {60 vars in 1138 bytes} [Mon Jul 4 09:58:24 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:58:26.302189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a7c-d658-4cd8-ba5d-68577593f1e7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:26.302726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a7c-d658-4cd8-ba5d-68577593f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:26.302726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a7c-d658-4cd8-ba5d-68577593f1e7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:26.304172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 576/1170] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:26.309309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584e86-8dae-489e-9fc6-b61b38e599fe None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:26.309690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584e86-8dae-489e-9fc6-b61b38e599fe None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:26.309876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584e86-8dae-489e-9fc6-b61b38e599fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:26.326903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a3584e86-8dae-489e-9fc6-b61b38e599fe None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:26.328119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a3584e86-8dae-489e-9fc6-b61b38e599fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:26.354163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:26.393956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 595/1171] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:26.418187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a7c-d658-4cd8-ba5d-68577593f1e7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:26.511249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:26.518188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a7c-d658-4cd8-ba5d-68577593f1e7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:26.552993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d8109-0000-436f-b58d-7bd8314f0029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:26.553782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d8109-0000-436f-b58d-7bd8314f0029 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:26.554068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d8109-0000-436f-b58d-7bd8314f0029 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:26.554341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d8109-0000-436f-b58d-7bd8314f0029 None admin] PATH_INFO: `/v3/domains/9096336d50eb4ccd9a55d412e075b711` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:26.565718 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d8109-0000-436f-b58d-7bd8314f0029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9096336d50eb4ccd9a55d412e075b711)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:26.567183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d8109-0000-436f-b58d-7bd8314f0029 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:26.568896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 577/1172] 10.222.0.78 () {56 vars in 1183 bytes} [Mon Jul 4 09:58:26 2022] GET /identity/v3/domains/9096336d50eb4ccd9a55d412e075b711 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:26.574751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3584e86-8dae-489e-9fc6-b61b38e599fe None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:26.669280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3584e86-8dae-489e-9fc6-b61b38e599fe None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:26.702466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc923397-99d4-4ff6-a4f2-b504555fcb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:26.703110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923397-99d4-4ff6-a4f2-b504555fcb90 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:26.703403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923397-99d4-4ff6-a4f2-b504555fcb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:26.703684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923397-99d4-4ff6-a4f2-b504555fcb90 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:26.704396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc923397-99d4-4ff6-a4f2-b504555fcb90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:26.705822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc923397-99d4-4ff6-a4f2-b504555fcb90 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:26.729387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 596/1173] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 09:58:26 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:58:28.801857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cd73-e790-4c24-a4c5-02f9a881ef04 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:28.802441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cd73-e790-4c24-a4c5-02f9a881ef04 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:28.802441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394cd73-e790-4c24-a4c5-02f9a881ef04 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:28.803846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 578/1174] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:28.809028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f23113-738b-49c1-8bc7-42d232516dd7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:28.809451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f23113-738b-49c1-8bc7-42d232516dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:28.809590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f23113-738b-49c1-8bc7-42d232516dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:28.827433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-27f23113-738b-49c1-8bc7-42d232516dd7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:28.828595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-27f23113-738b-49c1-8bc7-42d232516dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:28.838990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:28.895729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 597/1175] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:28.920397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cd73-e790-4c24-a4c5-02f9a881ef04 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:29.022179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394cd73-e790-4c24-a4c5-02f9a881ef04 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:29.055481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3e01-d1b9-4fde-9ba1-d9c28fb1dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:29.056360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3e01-d1b9-4fde-9ba1-d9c28fb1dd78 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:29.056644 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3e01-d1b9-4fde-9ba1-d9c28fb1dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:29.056923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3e01-d1b9-4fde-9ba1-d9c28fb1dd78 None admin] PATH_INFO: `/v3/domains/9096336d50eb4ccd9a55d412e075b711` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:29.058094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3e01-d1b9-4fde-9ba1-d9c28fb1dd78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9096336d50eb4ccd9a55d412e075b711)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:29.059527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3e01-d1b9-4fde-9ba1-d9c28fb1dd78 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:29.061715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 579/1176] 10.222.0.78 () {56 vars in 1183 bytes} [Mon Jul 4 09:58:28 2022] GET /identity/v3/domains/9096336d50eb4ccd9a55d412e075b711 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:29.067524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f23113-738b-49c1-8bc7-42d232516dd7 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:29.164337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f23113-738b-49c1-8bc7-42d232516dd7 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:29.198475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e6d6b-cd6c-4004-a58f-9b8ffe852faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:29.199140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6d6b-cd6c-4004-a58f-9b8ffe852faa None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:29.199424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6d6b-cd6c-4004-a58f-9b8ffe852faa None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:29.199728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6d6b-cd6c-4004-a58f-9b8ffe852faa None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:29.200436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e6d6b-cd6c-4004-a58f-9b8ffe852faa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:29.201888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e6d6b-cd6c-4004-a58f-9b8ffe852faa None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:29.221207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 598/1177] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:58:29 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 09:58:31.299464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04b5a5-5230-4d0a-b5b0-93ca063a26e2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:31.300307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04b5a5-5230-4d0a-b5b0-93ca063a26e2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:31.300307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04b5a5-5230-4d0a-b5b0-93ca063a26e2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:31.301673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 580/1178] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:31.306829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0add6-3c8e-43a2-840c-cde26f3c51b1 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:31.307256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0add6-3c8e-43a2-840c-cde26f3c51b1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:31.307361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0add6-3c8e-43a2-840c-cde26f3c51b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:31.312990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:31.326154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a4d0add6-3c8e-43a2-840c-cde26f3c51b1 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:31.327329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a4d0add6-3c8e-43a2-840c-cde26f3c51b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:31.392686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 599/1179] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:31.416032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04b5a5-5230-4d0a-b5b0-93ca063a26e2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:31.440727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:31.516649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04b5a5-5230-4d0a-b5b0-93ca063a26e2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:31.550464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:31.551195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:31.551479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:31.551781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:31.562615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:58:31.570275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:58:31.571454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:58:31.572566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 581/1180] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:58:31.577581 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0add6-3c8e-43a2-840c-cde26f3c51b1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:31.673900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0add6-3c8e-43a2-840c-cde26f3c51b1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:31.702157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:31.707517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:31.708209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:31.708495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:31.708780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:31.709533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:31.709843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:31.711225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:31.719949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 600/1181] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:31.725703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:31.811624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:31.828151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772d99a-d580-4f02-aeb7-626771fa2952 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:31.860578 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:31.861446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:31.861731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:31.862005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] PATH_INFO: `/v3/users/ebb48606bc534cc5a6aec5599d11aedb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:31.875344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=ebb48606bc534cc5a6aec5599d11aedb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:31.876827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:31.878493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 582/1182] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:31 2022] GET /identity/v3/users/ebb48606bc534cc5a6aec5599d11aedb => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:31.884304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:31.979748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c4d15-c39b-482b-8432-8d6eb2416ea4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:32.012158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:32.012788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:32.013095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:32.013369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:32.072084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:32.079637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:32.081073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:32.176105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 601/1183] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:58:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:58:32.181949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:32.283678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe91a-f926-4c50-9c67-081b10e71ac3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:32.317785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b72f5-6099-47a5-915f-e7f2400335e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:32.318638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b72f5-6099-47a5-915f-e7f2400335e8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:32.318924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b72f5-6099-47a5-915f-e7f2400335e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:32.319202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b72f5-6099-47a5-915f-e7f2400335e8 None admin] PATH_INFO: `/v3/projects/7af86c45dc4c4db59680de92a4e7901c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:32.320553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b72f5-6099-47a5-915f-e7f2400335e8 None admin] RBAC: Authorizing `identity:get_project(project_id=7af86c45dc4c4db59680de92a4e7901c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:32.322053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b72f5-6099-47a5-915f-e7f2400335e8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:32.323964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 583/1184] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:32 2022] GET /identity/v3/projects/7af86c45dc4c4db59680de92a4e7901c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:32.330716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:32.421323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:32.428488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2502f9-7ece-4bba-ba58-b45bb2897965 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:32.461586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19d975-c642-482e-a05b-a235bdfb2279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:32.462228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19d975-c642-482e-a05b-a235bdfb2279 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:32.462505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19d975-c642-482e-a05b-a235bdfb2279 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:32.462776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19d975-c642-482e-a05b-a235bdfb2279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:32.463617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19d975-c642-482e-a05b-a235bdfb2279 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=7af86c45dc4c4db59680de92a4e7901c, user.id=ebb48606bc534cc5a6aec5599d11aedb) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:32.463929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19d975-c642-482e-a05b-a235bdfb2279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:32.465347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19d975-c642-482e-a05b-a235bdfb2279 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:32.470604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 602/1185] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:58:32 2022] GET /identity/v3/role_assignments?user.id=ebb48606bc534cc5a6aec5599d11aedb&scope.project.id=7af86c45dc4c4db59680de92a4e7901c&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:34.487222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69996eb-89a8-44bb-8ccb-0d9dbda3a221 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:34.487823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69996eb-89a8-44bb-8ccb-0d9dbda3a221 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:34.487928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69996eb-89a8-44bb-8ccb-0d9dbda3a221 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:34.489312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 584/1186] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:34.494425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a86ac-e948-4e18-8364-caf5332f55e4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:34.494870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a86ac-e948-4e18-8364-caf5332f55e4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:34.494973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a86ac-e948-4e18-8364-caf5332f55e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:34.511557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-785a86ac-e948-4e18-8364-caf5332f55e4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:34.512779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-785a86ac-e948-4e18-8364-caf5332f55e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:34.579161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 603/1187] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:34.602359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69996eb-89a8-44bb-8ccb-0d9dbda3a221 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:34.615050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:34.708488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69996eb-89a8-44bb-8ccb-0d9dbda3a221 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:34.742051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:34.742765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:34.743042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:34.743313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:34.753183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:58:34.760869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:58:34.762034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:58:34.763102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 585/1188] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:58:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:58:34.768281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a86ac-e948-4e18-8364-caf5332f55e4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:34.853514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:34.866064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a86ac-e948-4e18-8364-caf5332f55e4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:34.898652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:34.899319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:34.899623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:34.899905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:34.900655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:34.900965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:34.902339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:34.910755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 604/1189] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:34.916579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:34.988524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:35.021062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111f23-0664-4314-accd-421b8cee4e4b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:35.054326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:35.055175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:35.055455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:35.055762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] PATH_INFO: `/v3/users/ebb48606bc534cc5a6aec5599d11aedb` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:35.056943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] RBAC: Authorizing `identity:get_user(user_id=ebb48606bc534cc5a6aec5599d11aedb)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:35.058353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:35.060632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 586/1190] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:34 2022] GET /identity/v3/users/ebb48606bc534cc5a6aec5599d11aedb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:35.066526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:35.163063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca7da-032b-421b-bad5-67bea0b59948 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:35.196680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c016f6-8337-4d0b-836a-0cc1417d6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:35.197532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c016f6-8337-4d0b-836a-0cc1417d6504 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:35.197818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c016f6-8337-4d0b-836a-0cc1417d6504 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:35.198096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c016f6-8337-4d0b-836a-0cc1417d6504 None admin] PATH_INFO: `/v3/projects/7af86c45dc4c4db59680de92a4e7901c` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:35.199276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c016f6-8337-4d0b-836a-0cc1417d6504 None admin] RBAC: Authorizing `identity:get_project(project_id=7af86c45dc4c4db59680de92a4e7901c)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:35.200944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c016f6-8337-4d0b-836a-0cc1417d6504 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:35.202555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 605/1191] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:35 2022] GET /identity/v3/projects/7af86c45dc4c4db59680de92a4e7901c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:35.208475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:35.308383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5d0a9-191a-4cc4-8d8b-9b4c8d4832ec None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:35.341779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a8d16-1d02-467a-87f6-06a5857ef204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:35.342660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8d16-1d02-467a-87f6-06a5857ef204 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:35.342949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8d16-1d02-467a-87f6-06a5857ef204 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:35.343228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8d16-1d02-467a-87f6-06a5857ef204 None admin] PATH_INFO: `/v3/projects/7af86c45dc4c4db59680de92a4e7901c/users/ebb48606bc534cc5a6aec5599d11aedb/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:35.345305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a8d16-1d02-467a-87f6-06a5857ef204 None admin] RBAC: Authorizing `identity:create_grant(project_id=7af86c45dc4c4db59680de92a4e7901c, user_id=ebb48606bc534cc5a6aec5599d11aedb, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:35.346722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a8d16-1d02-467a-87f6-06a5857ef204 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:35.354994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:35.361041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 587/1192] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:58:35 2022] PUT /identity/v3/projects/7af86c45dc4c4db59680de92a4e7901c/users/ebb48606bc534cc5a6aec5599d11aedb/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:58:37.344615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0967df-7a47-4fbe-a4bb-e0e3a67bfc50 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:37.345156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0967df-7a47-4fbe-a4bb-e0e3a67bfc50 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:37.345156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0967df-7a47-4fbe-a4bb-e0e3a67bfc50 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:37.346532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 606/1193] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:58:37.351737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb2cef-b4f0-4768-bd6f-d2b40c510893 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:37.352155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb2cef-b4f0-4768-bd6f-d2b40c510893 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:37.352291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb2cef-b4f0-4768-bd6f-d2b40c510893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:37.369164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-59fb2cef-b4f0-4768-bd6f-d2b40c510893 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:58:37.370360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-59fb2cef-b4f0-4768-bd6f-d2b40c510893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:58:37.435709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 588/1194] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:58:37.459457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0967df-7a47-4fbe-a4bb-e0e3a67bfc50 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:37.480803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:37.561349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0967df-7a47-4fbe-a4bb-e0e3a67bfc50 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:37.594963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:37.595732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:37.596015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:37.596294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:37.606623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:58:37.614208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:58:37.615350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:58:37.616482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 607/1195] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:58:37.621396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb2cef-b4f0-4768-bd6f-d2b40c510893 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:37.719294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb2cef-b4f0-4768-bd6f-d2b40c510893 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:37.744276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:37.752741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:37.753395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:37.753675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:37.753948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:37.754681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:37.754984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:37.756370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:37.764808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 589/1196] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:37.770494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:37.852707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:37.875235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41979828-4b37-4174-9598-18103a60d1e3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:37.909015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:37.909872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:37.910154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:37.910432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] PATH_INFO: `/v3/users/ebb48606bc534cc5a6aec5599d11aedb` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:37.911664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] RBAC: Authorizing `identity:get_user(user_id=ebb48606bc534cc5a6aec5599d11aedb)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:37.913086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:37.914707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 608/1197] 10.222.0.78 () {56 vars in 1177 bytes} [Mon Jul 4 09:58:37 2022] GET /identity/v3/users/ebb48606bc534cc5a6aec5599d11aedb => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:37.921094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:38.018772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7069-890a-49b4-b0d4-a8e282e4cd30 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:38.053546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:38.054190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:38.054564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:38.054844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:38.112894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:38.123890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:38.125331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:38.219519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 590/1198] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:58:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:58:38.225579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:38.322704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e2508-7b23-4354-817d-8ab3e3de8aeb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:38.355211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d6717-6f9e-4617-908d-2aa68aa015d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:38.356086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6717-6f9e-4617-908d-2aa68aa015d4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:38.356960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6717-6f9e-4617-908d-2aa68aa015d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:38.357233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d6717-6f9e-4617-908d-2aa68aa015d4 None admin] PATH_INFO: `/v3/projects/7af86c45dc4c4db59680de92a4e7901c` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:38.358388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6717-6f9e-4617-908d-2aa68aa015d4 None admin] RBAC: Authorizing `identity:get_project(project_id=7af86c45dc4c4db59680de92a4e7901c)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:38.359842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d6717-6f9e-4617-908d-2aa68aa015d4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:38.361527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 609/1199] 10.222.0.78 () {56 vars in 1186 bytes} [Mon Jul 4 09:58:38 2022] GET /identity/v3/projects/7af86c45dc4c4db59680de92a4e7901c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:38.367601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:58:38.473591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:38.484508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6a68d-0aa9-4325-896e-c42cf0854681 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:58:38.517422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed541bd-80e2-4910-af2a-47eb7f4b7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:58:38.518075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed541bd-80e2-4910-af2a-47eb7f4b7398 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:58:38.518363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed541bd-80e2-4910-af2a-47eb7f4b7398 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:58:38.518642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed541bd-80e2-4910-af2a-47eb7f4b7398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:58:38.519474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed541bd-80e2-4910-af2a-47eb7f4b7398 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=7af86c45dc4c4db59680de92a4e7901c, user.id=ebb48606bc534cc5a6aec5599d11aedb) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:58:38.519825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed541bd-80e2-4910-af2a-47eb7f4b7398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:58:38.521269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed541bd-80e2-4910-af2a-47eb7f4b7398 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:58:38.530118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 591/1200] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:58:38 2022] GET /identity/v3/role_assignments?user.id=ebb48606bc534cc5a6aec5599d11aedb&scope.project.id=7af86c45dc4c4db59680de92a4e7901c&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:58:48.351171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:58:48.525913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=23 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:34.220689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b227-6178-41ea-b7eb-24b68d481516 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:34.221283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b227-6178-41ea-b7eb-24b68d481516 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:34.221377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b227-6178-41ea-b7eb-24b68d481516 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:34.222849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 610/1201] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:59:34.231087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3abe40-98db-4eb8-b3c0-9e0c01fb2df0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:34.231087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3abe40-98db-4eb8-b3c0-9e0c01fb2df0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:34.231087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3abe40-98db-4eb8-b3c0-9e0c01fb2df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:34.249097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cb3abe40-98db-4eb8-b3c0-9e0c01fb2df0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:59:34.250582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cb3abe40-98db-4eb8-b3c0-9e0c01fb2df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:59:34.342795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 592/1202] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:59:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:59:34.372104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5b227-6178-41ea-b7eb-24b68d481516 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:34.503346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5b227-6178-41ea-b7eb-24b68d481516 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:34.549933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:34.551024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:34.551307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:34.551602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:34.567881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:34.569505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:34.595099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:34.596243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:34.597232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:34.597232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:34.597232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:34.597232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:34.597232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 611/1203] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:34.605874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3abe40-98db-4eb8-b3c0-9e0c01fb2df0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:34.738425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3abe40-98db-4eb8-b3c0-9e0c01fb2df0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:34.775646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:34.783295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eabce-17a8-4b6d-85b9-ca12317ed8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:34.784323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eabce-17a8-4b6d-85b9-ca12317ed8ec None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:34.784841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eabce-17a8-4b6d-85b9-ca12317ed8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:34.785124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eabce-17a8-4b6d-85b9-ca12317ed8ec None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:34.785856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eabce-17a8-4b6d-85b9-ca12317ed8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:34.786327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eabce-17a8-4b6d-85b9-ca12317ed8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:34.787740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eabce-17a8-4b6d-85b9-ca12317ed8ec None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:34.801235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 593/1204] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:34.808237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:34.877888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:34.947133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847db2f-c7b6-4d5d-b7dc-80c3acc41ff0 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:34.992140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e112c4-260b-47af-9a68-3ab31106fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:34.992715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e112c4-260b-47af-9a68-3ab31106fa37 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:34.992997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e112c4-260b-47af-9a68-3ab31106fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:34.993267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e112c4-260b-47af-9a68-3ab31106fa37 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:34.994006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e112c4-260b-47af-9a68-3ab31106fa37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:34.996470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e112c4-260b-47af-9a68-3ab31106fa37 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:35.021164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 612/1205] 10.222.0.78 () {60 vars in 1132 bytes} [Mon Jul 4 09:59:34 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 09:59:37.325757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ca08-04cb-4a1e-a3b2-81c92b6ef108 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:37.326344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ca08-04cb-4a1e-a3b2-81c92b6ef108 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:37.326344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ca08-04cb-4a1e-a3b2-81c92b6ef108 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:37.327738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 594/1206] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:59:37.333557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234786-24ad-49c5-8a3d-616e065f3b15 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:37.333998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234786-24ad-49c5-8a3d-616e065f3b15 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:37.334090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234786-24ad-49c5-8a3d-616e065f3b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:37.355123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9f234786-24ad-49c5-8a3d-616e065f3b15 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:59:37.355123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9f234786-24ad-49c5-8a3d-616e065f3b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:59:37.436965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 613/1207] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:59:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 09:59:37.465132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36ca08-04cb-4a1e-a3b2-81c92b6ef108 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:37.600741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36ca08-04cb-4a1e-a3b2-81c92b6ef108 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:37.641652 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:37.642450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:37.642734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:37.643026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:37.653293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:59:37.661027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:37.662039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:37.662916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 595/1208] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:37.668786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234786-24ad-49c5-8a3d-616e065f3b15 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:37.715523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:37.792808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234786-24ad-49c5-8a3d-616e065f3b15 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:37.831828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:37.832420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:37.832702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:37.832976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:37.833731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:37.834102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:37.835403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:37.850498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 614/1209] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:59:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:37.851822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:37.913727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:37.976054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3a507-af60-4098-89b9-51aa90665c73 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:38.019706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:38.020516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:38.020800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:38.021076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:38.036609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:38.038504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:38.059898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:38.061056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:38.062194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:38.062194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:38.062194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:38.062194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:38.067599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 596/1210] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:38.067753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:38.189058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:38.192552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce29d0-e875-46e5-9cc0-76e3b60a8536 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:38.234797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:38.235478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:38.235796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:38.236078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:38.236816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:38.237153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:38.238636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:38.253988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 615/1211] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:38.260981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:38.380129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d737b4-d70d-402e-a971-6904cb564e9f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:38.381949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:38.426636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:38.427559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:38.427908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:38.429141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:38.436660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:38.438229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:59:38.455792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:38.457088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:38.458304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:38.464463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 597/1212] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:38.465917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:38.586541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0e39-ffec-4531-901e-9b8cbca14992 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:38.634366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:38.635781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:38.636098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:38.636524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:38.637754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:38.638209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:38.640180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:38.668592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 616/1213] 10.222.0.78 () {56 vars in 1143 bytes} [Mon Jul 4 09:59:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:38.670944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:38.798447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a9c1d-62a8-4019-a76c-d0ea63287ad8 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:38.840007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:38.840712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:38.841019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:38.841793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:38.879103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:38.934945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:38.937229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:39.075280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 598/1214] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:59:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:59:39.081129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:39.102840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:39.200324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7711d4-7a3f-4109-aaa8-160517e24d40 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:39.246072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:39.246920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:39.247242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:39.247546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:39.260840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:39.263294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:39.286210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:39.287376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:39.288434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:39.288434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:39.288434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:39.288434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:39.288434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 617/1215] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:39.295085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:39.368276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:39.413053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fedde-d8d3-4ee2-8bef-aa2d5ef87ab2 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:39.452096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:39.453194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:39.453600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:39.453911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:39.454765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:39.455147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:39.456618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:39.475521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 599/1216] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:39.477135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:39.558857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:39.598012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57187db1-5505-4516-9fcf-685d97ef492a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:39.634546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:39.635456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:39.635918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:39.636273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:39.643684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:39.645225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:59:39.660766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:39.661828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:39.662749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:39.667481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 618/1217] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:39.668982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:39.798549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f28c92-f5e4-4dce-b9d1-60b3333b619f None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:39.829282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:39.844611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02be6b-f6aa-41de-9507-dc2d027babad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:39.845410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02be6b-f6aa-41de-9507-dc2d027babad None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:39.845699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02be6b-f6aa-41de-9507-dc2d027babad None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:39.846056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02be6b-f6aa-41de-9507-dc2d027babad None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:39.847116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02be6b-f6aa-41de-9507-dc2d027babad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:39.847450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02be6b-f6aa-41de-9507-dc2d027babad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:39.849314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02be6b-f6aa-41de-9507-dc2d027babad None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:39.869097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 600/1218] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:39.871052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:39.996332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099e609-9cb2-4b47-9369-e77e100206cc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:40.029996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:40.038141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860eb5b-0f4e-4992-ae04-3716ef2d9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:40.038889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860eb5b-0f4e-4992-ae04-3716ef2d9d49 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:40.039236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860eb5b-0f4e-4992-ae04-3716ef2d9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:40.039613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860eb5b-0f4e-4992-ae04-3716ef2d9d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:40.040717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860eb5b-0f4e-4992-ae04-3716ef2d9d49 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3fe12b3ec01547eba1493e7a179c8af9) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:40.041053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860eb5b-0f4e-4992-ae04-3716ef2d9d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:40.043548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860eb5b-0f4e-4992-ae04-3716ef2d9d49 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:40.063603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 619/1219] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:59:39 2022] GET /identity/v3/role_assignments?user.id=3fe12b3ec01547eba1493e7a179c8af9&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:42.219532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969673-7b00-4485-b164-3c22d2925961 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:42.220189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969673-7b00-4485-b164-3c22d2925961 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:42.220189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969673-7b00-4485-b164-3c22d2925961 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:42.221834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 601/1220] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:59:42.227688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389418-7ab7-42e9-b852-9fddad1b9e9c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:42.228123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389418-7ab7-42e9-b852-9fddad1b9e9c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:42.228342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389418-7ab7-42e9-b852-9fddad1b9e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:42.247984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f9389418-7ab7-42e9-b852-9fddad1b9e9c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:59:42.249392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f9389418-7ab7-42e9-b852-9fddad1b9e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:59:42.336459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 620/1221] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:59:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:59:42.362372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01969673-7b00-4485-b164-3c22d2925961 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:42.481162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01969673-7b00-4485-b164-3c22d2925961 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:42.520578 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:42.521480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:42.521768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:42.522134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:42.534665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:59:42.543438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:42.544824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:42.545706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 602/1222] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:42.551296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389418-7ab7-42e9-b852-9fddad1b9e9c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:42.661551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389418-7ab7-42e9-b852-9fddad1b9e9c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:42.686401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:42.698514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:42.699190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:42.699497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:42.699783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:42.700583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] RBAC: Adding query filter params (name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:42.700859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:42.702221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:42.711069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 621/1223] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:42.718749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:42.767112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:42.835592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e4eec-2009-4da6-b992-4082646cffdd None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:42.871495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:42.872371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:42.872742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:42.873009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:42.886598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:42.888271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:42.908625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:42.909638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:42.910588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:42.910588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:42.910588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:42.910588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:42.910588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 603/1224] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:42.917864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:43.024012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9c8af-a9bb-4b9b-a9bf-2b7f160e175a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:43.059594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:43.060380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:43.060717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:43.061086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:43.061952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:43.062386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:43.063936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:43.077557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 622/1225] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:59:43.084120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:43.204880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:43.212396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996a98-e047-4272-9ae9-8134f58b3cf9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:43.250490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:43.251901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:43.252423 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:43.252934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:43.262878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:43.264466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:59:43.283950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:43.285254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:43.286475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 604/1226] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:59:43.291871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:43.343012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:43.403501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ef44-3720-4913-a727-5e18bc974030 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:43.438207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:43.438880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:43.439167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:43.439441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:43.440322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:43.440633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:43.442079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:43.460978 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 623/1227] 10.222.0.78 () {56 vars in 1143 bytes} [Mon Jul 4 09:59:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:43.467283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:43.586299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d9e22-0130-41fb-9f2f-ac00e56aed50 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:43.626257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:43.627163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:43.627440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:43.627745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:43.643407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:43.645177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:43.667435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:43.668816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:43.669911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:43.669911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:43.669911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:43.669911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:43.669911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 605/1228] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:43.675730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:43.800514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1e6c-628b-4272-8936-f1ef46d90f2d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:43.803605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:43.847967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:43.848565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:43.848847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:43.849123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:43.849852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:43.850157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:43.851861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:43.865852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 624/1229] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:43.874125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:43.885395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:43.996722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3617d3-e2d6-4195-9933-1492baa4c9a5 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:44.039953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:44.041298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:44.041572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:44.041848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:44.050299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:44.052104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:59:44.068927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:44.070080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:44.071188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 606/1230] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:44.076061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:44.194261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b49c1-920a-4e70-b8e2-7e48b4d72499 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:44.233199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a1145-9400-4f45-b18d-2f2fa9dc5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:44.233962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a1145-9400-4f45-b18d-2f2fa9dc5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:44.234249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a1145-9400-4f45-b18d-2f2fa9dc5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:44.234528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a1145-9400-4f45-b18d-2f2fa9dc5ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:44.235429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a1145-9400-4f45-b18d-2f2fa9dc5ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:44.235809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a1145-9400-4f45-b18d-2f2fa9dc5ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:44.237459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a1145-9400-4f45-b18d-2f2fa9dc5ac8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:44.252544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 625/1231] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:44.258869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:44.340269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:44.379228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1298-3192-4ba8-aef1-f78b9712427b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:44.415716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e213291-65fb-4175-8d0a-3f89cddc92f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:44.417173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213291-65fb-4175-8d0a-3f89cddc92f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:44.417456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213291-65fb-4175-8d0a-3f89cddc92f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:44.417734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213291-65fb-4175-8d0a-3f89cddc92f9 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3fe12b3ec01547eba1493e7a179c8af9/roles/4ffa6416473b43719c4b6241a1af7b13` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:44.433656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e213291-65fb-4175-8d0a-3f89cddc92f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=3fe12b3ec01547eba1493e7a179c8af9, role_id=4ffa6416473b43719c4b6241a1af7b13)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:44.435405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e213291-65fb-4175-8d0a-3f89cddc92f9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:44.448298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 607/1232] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:59:44 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3fe12b3ec01547eba1493e7a179c8af9/roles/4ffa6416473b43719c4b6241a1af7b13 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 09:59:46.646493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc8bb-ff18-4065-8659-dd1174bbc8ee None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:46.647021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc8bb-ff18-4065-8659-dd1174bbc8ee None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:46.647021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc8bb-ff18-4065-8659-dd1174bbc8ee None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:46.648444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 626/1233] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:59:46.653584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6047-48a5-4f00-a583-91dcc8dada1a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:46.653979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6047-48a5-4f00-a583-91dcc8dada1a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:46.654158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6047-48a5-4f00-a583-91dcc8dada1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:46.671177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-63bb6047-48a5-4f00-a583-91dcc8dada1a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:59:46.672440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-63bb6047-48a5-4f00-a583-91dcc8dada1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:59:46.743265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 608/1234] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:59:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:59:46.768600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cc8bb-ff18-4065-8659-dd1174bbc8ee None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:46.795369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:46.884062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cc8bb-ff18-4065-8659-dd1174bbc8ee None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:46.923002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:46.924116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:46.924397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:46.924704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:46.937650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:59:46.946925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:46.948078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:46.948980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 627/1235] 10.222.0.78 () {56 vars in 1102 bytes} [Mon Jul 4 09:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:46.954435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6047-48a5-4f00-a583-91dcc8dada1a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:47.003816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:47.063623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6047-48a5-4f00-a583-91dcc8dada1a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:47.107304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:47.108385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:47.108794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:47.109197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:47.111788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] RBAC: Adding query filter params (name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:47.111788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:47.113297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:47.128682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 609/1236] 10.222.0.78 () {56 vars in 1103 bytes} [Mon Jul 4 09:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:47.134248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:47.230120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:47.250081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50a9d7-9451-496d-9841-82e59f64116d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:47.294991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:47.295952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:47.296269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:47.296645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:47.308837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:47.310413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:47.331161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:47.332393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:47.333462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:47.333462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:47.333462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:47.333462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:47.333462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 628/1237] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 09:59:47.339295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:47.461447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c197a82-2b72-4ccc-a1f4-0af84d394eac None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:47.472495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:47.502608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:47.503537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:47.503849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:47.504126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:47.504847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:47.505153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:47.506508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:47.519607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 610/1238] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:59:47.527586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:47.640077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a343e-4bb7-4744-8d51-ba1568d94eba None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:47.676233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:47.677208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:47.677495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:47.677773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:47.680860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:47.686783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:47.688779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:59:47.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:47.706999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:47.708228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 629/1239] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:47.713716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:47.829568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77191413-a959-4040-9d96-37da0b9327c3 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:47.866343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:47.867111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:47.867495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:47.867808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:47.868653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:47.868991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:47.870655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:47.890802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 611/1240] 10.222.0.78 () {56 vars in 1143 bytes} [Mon Jul 4 09:59:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:47.896546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:48.014471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4045f-8173-4012-a8a8-2d8ad6841515 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:48.051024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:48.051787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:48.052122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:48.052406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:48.118726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:48.126594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:48.128100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:48.247067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 630/1241] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:59:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 09:59:48.253112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:48.284546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:48.373780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf8632-273b-49fa-9ad1-f0f30df82570 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:48.414300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:48.415154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:48.415433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:48.416277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:48.427889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:48.429286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:48.448520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:48.449519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:48.455139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:48.455139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:48.455139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:48.455139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:48.455139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 612/1242] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:48.455534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:48.554153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:48.565076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179d5a-69bd-4347-9b28-b75dfd9d60f3 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:48.605365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:48.606176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:48.606468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:48.606837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:48.607593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:48.607976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:48.609714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:48.623778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 631/1243] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:48.632706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:48.731599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:48.758153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678ac58-9009-4978-a8c9-34febd906030 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:48.800050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:48.801088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:48.801437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:48.801782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:48.811422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:48.813037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:59:48.830486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:48.831654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:48.832591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 613/1244] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:48.839768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:48.954634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c2187-a2a6-4d83-9642-987d11706d7d None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:48.992089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45e33-42b0-44ce-acf8-49da7d5a138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:48.992767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45e33-42b0-44ce-acf8-49da7d5a138f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:48.993084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45e33-42b0-44ce-acf8-49da7d5a138f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:48.993335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45e33-42b0-44ce-acf8-49da7d5a138f None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:48.994811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45e33-42b0-44ce-acf8-49da7d5a138f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:48.995130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45e33-42b0-44ce-acf8-49da7d5a138f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:48.996636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45e33-42b0-44ce-acf8-49da7d5a138f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:49.010148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 632/1245] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:49.016147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:49.128316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dfdbb-5f18-4e2d-b23c-3eba583f767d None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:49.172422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635801a-ed3e-4492-af02-5da4d79fa7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:49.173853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635801a-ed3e-4492-af02-5da4d79fa7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:49.174209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635801a-ed3e-4492-af02-5da4d79fa7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:49.174518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635801a-ed3e-4492-af02-5da4d79fa7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:49.175602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635801a-ed3e-4492-af02-5da4d79fa7c1 None admin] RBAC: Adding query filter params (role.id=4ffa6416473b43719c4b6241a1af7b13, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3fe12b3ec01547eba1493e7a179c8af9) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:49.175971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635801a-ed3e-4492-af02-5da4d79fa7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:49.177726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635801a-ed3e-4492-af02-5da4d79fa7c1 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:49.187117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 614/1246] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:59:49 2022] GET /identity/v3/role_assignments?user.id=3fe12b3ec01547eba1493e7a179c8af9&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=4ffa6416473b43719c4b6241a1af7b13 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:51.406409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971603b-c3a3-4080-8022-54ca51ce882c None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:51.406977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971603b-c3a3-4080-8022-54ca51ce882c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:51.407084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971603b-c3a3-4080-8022-54ca51ce882c None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:51.408617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 633/1247] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:59:51.414028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562359c-158d-4cb4-9e7b-bbedc8036987 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:51.414498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562359c-158d-4cb4-9e7b-bbedc8036987 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:51.414614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562359c-158d-4cb4-9e7b-bbedc8036987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:51.420620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:51.435013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f562359c-158d-4cb4-9e7b-bbedc8036987 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:59:51.436319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f562359c-158d-4cb4-9e7b-bbedc8036987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:59:51.511728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 615/1248] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:59:51.535082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971603b-c3a3-4080-8022-54ca51ce882c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:51.554606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:51.660857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971603b-c3a3-4080-8022-54ca51ce882c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:51.707986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:51.708950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:51.709347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:51.709753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:51.724886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:59:51.732858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:51.734142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:51.735374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 634/1249] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:51.740340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562359c-158d-4cb4-9e7b-bbedc8036987 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:51.856848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562359c-158d-4cb4-9e7b-bbedc8036987 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:51.889356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:51.895640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:51.896306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:51.896631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:51.897037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:51.898064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:51.898694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:51.899982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:51.910127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 616/1250] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:59:51.917199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:52.011163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:52.041815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2ea4e-96c7-44aa-83ef-36fe7d27b847 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:52.080256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:52.081061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:52.081465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:52.081741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:52.095845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:52.097600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:52.119945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:52.121104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:52.122033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:52.122033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:52.122033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:52.122033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:52.122033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 635/1251] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:52.127734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:52.252456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a524c4-27c9-4989-8f40-d6fb938b1494 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:52.303361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:52.304331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:52.304768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:52.305068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:52.305769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:52.306723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:52.308089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:52.323020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 617/1252] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:52.329261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:52.443795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf73bda-35ec-4e61-847a-50d855903d94 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:52.473840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:52.485035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:52.486062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:52.486447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:52.486728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:52.497508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:52.499244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:59:52.519316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:52.520816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:52.521856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 636/1253] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:52.528288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:52.596622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:52.651156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6ac4-5350-4563-a3ed-1a943c2970f6 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:52.688985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:52.689766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:52.690053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:52.690331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:52.691189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:52.691501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:52.693062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:52.713952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 618/1254] 10.222.0.78 () {56 vars in 1143 bytes} [Mon Jul 4 09:59:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:52.720841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:52.831012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847369-33c7-4b24-9edb-042c4bfada7a None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:52.867878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:52.869030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:52.869315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:52.869615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:52.938289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:52.956443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:52.958145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:53.066651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 637/1255] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 09:59:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 09:59:53.072830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:53.184356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14162d7e-6824-412a-a536-c2858f64ee48 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:53.199277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:53.222655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:53.223633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:53.223980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:53.224236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:53.236491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:53.238207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:53.257727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:53.258737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:53.260295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:53.260295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:53.260295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:53.260295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:53.260295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 619/1256] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:53.265950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:53.365154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:53.378792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb331-8601-4b75-94e4-66080bd03feb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:53.421196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:53.421994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:53.422379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:53.422931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:53.423709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:53.424021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:53.425402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:53.437211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 638/1257] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:59:53.442994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:53.554242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ab6cd-ccf4-451b-81a3-adb25911e230 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:53.596376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:53.597195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:53.597483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:53.597768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:53.605710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:53.607199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:59:53.623562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:53.624577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:53.625602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 09:59:53.626633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 620/1258] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:53.633428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:53.739569 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8633b9-223d-4172-bef3-381cfeb58c99 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:53.774031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930fa2f-6ec2-49b2-8058-75ccd7e9294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:53.774701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930fa2f-6ec2-49b2-8058-75ccd7e9294a None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:53.775164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930fa2f-6ec2-49b2-8058-75ccd7e9294a None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:53.775689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930fa2f-6ec2-49b2-8058-75ccd7e9294a None admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:53.776696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930fa2f-6ec2-49b2-8058-75ccd7e9294a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:53.777011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930fa2f-6ec2-49b2-8058-75ccd7e9294a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:53.778680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930fa2f-6ec2-49b2-8058-75ccd7e9294a None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:53.792755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 639/1259] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:53.799513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:53.827101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:53.907041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745fe4-b7a2-4e4e-9862-bd9851f3a061 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:53.944362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99995-8025-4a0f-89ae-85314b5ad5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:53.945020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99995-8025-4a0f-89ae-85314b5ad5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:53.945302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99995-8025-4a0f-89ae-85314b5ad5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:53.945577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99995-8025-4a0f-89ae-85314b5ad5d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:53.946407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99995-8025-4a0f-89ae-85314b5ad5d3 None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3fe12b3ec01547eba1493e7a179c8af9) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:53.947249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99995-8025-4a0f-89ae-85314b5ad5d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:53.948716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99995-8025-4a0f-89ae-85314b5ad5d3 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:53.954265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 621/1260] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 09:59:53 2022] GET /identity/v3/role_assignments?user.id=3fe12b3ec01547eba1493e7a179c8af9&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:55.982890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444067ea-d8ae-4674-8073-e1ab5f454fbd None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:55.983427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444067ea-d8ae-4674-8073-e1ab5f454fbd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:55.983427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444067ea-d8ae-4674-8073-e1ab5f454fbd None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:55.984866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 640/1261] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:59:55.990114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e59a-4cf6-4895-8c95-8cd086b02371 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:55.990535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e59a-4cf6-4895-8c95-8cd086b02371 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:55.990668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e59a-4cf6-4895-8c95-8cd086b02371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:56.007057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-11e9e59a-4cf6-4895-8c95-8cd086b02371 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:59:56.008270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-11e9e59a-4cf6-4895-8c95-8cd086b02371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:59:56.073262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 622/1262] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:59:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 09:59:56.095875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444067ea-d8ae-4674-8073-e1ab5f454fbd None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:56.106471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:56.193503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444067ea-d8ae-4674-8073-e1ab5f454fbd None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:56.226267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:56.227037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:56.227316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:56.228121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:56.239217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 09:59:56.247344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:56.248500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:56.249537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 641/1263] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 09:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:56.254802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e59a-4cf6-4895-8c95-8cd086b02371 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:56.279021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:56.370734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e59a-4cf6-4895-8c95-8cd086b02371 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:56.404380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:56.405047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:56.405334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:56.405615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:56.406362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:56.406672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:56.408070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:56.416758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 623/1264] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 09:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:56.422958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:56.488152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:56.520281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c3f5-39cb-4098-88ac-747a5313c9cb None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:56.553123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:56.553893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:56.554172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:56.554443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:56.564865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:56.566297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:56.582967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:56.584078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:56.585219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:56.585219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:56.585219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:56.585219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:56.585219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 642/1265] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:56.590368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:56.675391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:56.694585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe78c3-d8d5-4d2e-8f0b-5238ef289444 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:56.730081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:56.730742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:56.731035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:56.731316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:56.732073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:56.732386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:56.733743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:56.745359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 624/1266] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:56.751007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:56.849694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378337-5e10-485b-889c-7ba5e0311fbd None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:56.868468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:56.882397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:56.883186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:56.883473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:56.884302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:56.891823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:56.893268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 09:59:56.907840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:56.908985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:56.910338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 643/1267] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:56.914715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:57.014965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41aba8-381a-4c61-aa5b-3ca8f06c0cf4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:57.048380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:57.049047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:57.049333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:57.049614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:57.050461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:57.050777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:57.052244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:57.061280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:57.070265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 625/1268] 10.222.0.78 () {56 vars in 1143 bytes} [Mon Jul 4 09:59:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:57.075889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:57.175019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e008a0-a26c-4ab6-90f8-55f94725670c None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:57.206921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:57.207721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:57.208004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:57.208277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:57.218948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:57.220421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 09:59:57.237476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:57.238586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:57.239944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 09:59:57.239944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 09:59:57.239944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 09:59:57.239944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:57.239944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 644/1269] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 09:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:57.244865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:57.351085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a9693-af79-4e76-bde8-2c8626103657 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:57.384777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:57.385440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:57.385722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:57.385997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:57.386723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:57.387033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:57.388432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:57.399798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 626/1270] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 09:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 09:59:57.405490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:57.437942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:57.505353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e6d8b-14fb-4fd6-904e-0b89fb9147f8 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:57.538892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:57.539704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:57.539993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:57.540865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:57.547693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:57.549144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 09:59:57.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 09:59:57.564861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 09:59:57.565926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 645/1271] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 09:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 09:59:57.570706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:57.628781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:57.669466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb80a-ae91-475c-8096-1507b09150f9 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:57.702299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d9e38-66dc-4450-82d3-f8cd4513d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:57.702883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9e38-66dc-4450-82d3-f8cd4513d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:57.703163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9e38-66dc-4450-82d3-f8cd4513d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:57.703437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9e38-66dc-4450-82d3-f8cd4513d3e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:57.704241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9e38-66dc-4450-82d3-f8cd4513d3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 09:59:57.704548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9e38-66dc-4450-82d3-f8cd4513d3e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:57.705952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9e38-66dc-4450-82d3-f8cd4513d3e9 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:57.717916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 627/1272] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 09:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 09:59:57.723893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 09:59:57.814047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:59:57.822766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9f3e-6180-41a6-8b4a-dda1a2d9df2b None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 09:59:57.856383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121782-020e-40c2-bd41-55a847645b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 09:59:57.857258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121782-020e-40c2-bd41-55a847645b46 None admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:57.857543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121782-020e-40c2-bd41-55a847645b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:57.857822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121782-020e-40c2-bd41-55a847645b46 None admin] PATH_INFO: `/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3fe12b3ec01547eba1493e7a179c8af9/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:57.859799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3121782-020e-40c2-bd41-55a847645b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd1740dc99442498a29fabcc4aa8bb8, user_id=3fe12b3ec01547eba1493e7a179c8af9, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 09:59:57.861236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3121782-020e-40c2-bd41-55a847645b46 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 09:59:57.873914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 646/1273] 10.222.0.78 () {58 vars in 1439 bytes} [Mon Jul 4 09:59:57 2022] PUT /identity/v3/projects/2cd1740dc99442498a29fabcc4aa8bb8/users/3fe12b3ec01547eba1493e7a179c8af9/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 09:59:59.896375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470c9b-7ac2-403a-b1b9-a3121979533a None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:59.896991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470c9b-7ac2-403a-b1b9-a3121979533a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:59.896991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470c9b-7ac2-403a-b1b9-a3121979533a None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:59.898219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 628/1274] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 09:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 09:59:59.903363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc317-cca0-4c00-b33f-2e3126ca3521 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 09:59:59.903804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc317-cca0-4c00-b33f-2e3126ca3521 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 09:59:59.903970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc317-cca0-4c00-b33f-2e3126ca3521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 09:59:59.921015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-199bc317-cca0-4c00-b33f-2e3126ca3521 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 09:59:59.922205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-199bc317-cca0-4c00-b33f-2e3126ca3521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 09:59:59.988469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 647/1275] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 09:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 10:00:00.012449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470c9b-7ac2-403a-b1b9-a3121979533a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:00.111754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470c9b-7ac2-403a-b1b9-a3121979533a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:00.128921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:00.146088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:00.146914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:00.147153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:00.147430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:00.157354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 10:00:00.164992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:00.166164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:00.167284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 629/1276] 10.222.0.78 () {56 vars in 1096 bytes} [Mon Jul 4 10:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:00.172199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bc317-cca0-4c00-b33f-2e3126ca3521 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:00.253794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:00.277506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bc317-cca0-4c00-b33f-2e3126ca3521 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:00.314188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:00.314853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:00.315137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:00.315411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:00.316192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:00.316497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:00.317860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:00.326322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 648/1277] 10.222.0.78 () {56 vars in 1099 bytes} [Mon Jul 4 10:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:00.332118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:00.430312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17aa0-cd60-4b2b-baab-18e2a83606ab None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:00.463473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:00.464282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:00.464566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:00.464844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:00.475145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:00.476620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 10:00:00.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:00.495494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:00.496806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 10:00:00.496806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 10:00:00.496806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 10:00:00.496806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:00.496806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 630/1278] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 10:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:00.501444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:00.600869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa151f-5af4-462c-9207-8655302ff4c4 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:00.634265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:00.634829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:00.635113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:00.635388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:00.636141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:00.636450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:00.637813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:00.649217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 649/1279] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 10:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:00.654916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:00.686631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:00.757233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0867c9-1a5e-42a6-ac64-b66a9c5eaa6b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:00.789525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:00.790918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:00.791226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:00.791503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:00.799146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:00.800615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 10:00:00.815483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:00.816673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:00.817956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 631/1280] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 10:00:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:00.822793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:00.826726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:00.921580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b266122-9a70-432f-a772-c242a5d47442 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:00.955691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:00.956295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:00.956578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:00.956853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:00.957716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:00.958030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:00.959452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:00.976156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 650/1281] 10.222.0.78 () {56 vars in 1143 bytes} [Mon Jul 4 10:00:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:00:00.982076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:01.072738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:01.082756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc865eb-eff7-45bc-8e9d-edae6c64417b None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:01.115504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:01.116170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:01.116457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:01.116737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:01.183821 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:01.185256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:01.272490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:01.284557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 632/1282] 10.222.0.78 () {58 vars in 1282 bytes} [Mon Jul 4 10:00:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 10:00:01.291251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:01.351096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:01.388487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f21a8-99fa-4465-ba23-85bdba35d4bc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:01.421350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:01.422131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:01.422669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:01.422942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:01.432732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:01.434175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 10:00:01.452078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:01.453201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:01.454195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 10:00:01.454195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 10:00:01.454195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 10:00:01.454195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 10:00:01.454195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 651/1283] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 10:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:01.458961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:01.554452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab913-e141-487b-b065-3e60d301f6d4 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:01.589330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:01.589997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:01.590284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:01.590570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:01.591298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:01.591643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:01.593002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:01.604699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 633/1284] 10.222.0.78 () {56 vars in 1109 bytes} [Mon Jul 4 10:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:01.610228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:01.706180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7ead-771a-4732-9a02-43da730690bc None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:01.720088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:01.741154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:01.741934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:01.742218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:01.742495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:01.749051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:01.750485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 10:00:01.763889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:01.764991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: ERROR keystone.server.flask.application Jul 04 10:00:01.766130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 652/1285] 10.222.0.78 () {56 vars in 1111 bytes} [Mon Jul 4 10:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:01.770827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:01.820444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:01.869540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2c552-b570-4a59-aba2-e8880cb0e102 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:01.902485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe452b-6e56-41b1-9586-7ae7bf9f422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:01.903143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe452b-6e56-41b1-9586-7ae7bf9f422d None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:01.903430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe452b-6e56-41b1-9586-7ae7bf9f422d None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:01.903742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe452b-6e56-41b1-9586-7ae7bf9f422d None admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:01.904532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe452b-6e56-41b1-9586-7ae7bf9f422d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:01.904845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe452b-6e56-41b1-9586-7ae7bf9f422d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:01.906271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe452b-6e56-41b1-9586-7ae7bf9f422d None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:01.918642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 634/1286] 10.222.0.78 () {56 vars in 1148 bytes} [Mon Jul 4 10:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:01.924946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:02.030614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7493df-6c8d-48b0-a2ae-7874dc9b57ee None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:02.064182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91216ad1-135c-4608-8fd5-5db737c6d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:02.064831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91216ad1-135c-4608-8fd5-5db737c6d02e None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:02.065110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91216ad1-135c-4608-8fd5-5db737c6d02e None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:02.065383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91216ad1-135c-4608-8fd5-5db737c6d02e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:02.066209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91216ad1-135c-4608-8fd5-5db737c6d02e None admin] RBAC: Adding query filter params (role.id=751630036fa149ecb8a57e9a6c98cca9, scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8, user.id=3fe12b3ec01547eba1493e7a179c8af9) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:02.066517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91216ad1-135c-4608-8fd5-5db737c6d02e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:02.067964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91216ad1-135c-4608-8fd5-5db737c6d02e None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:02.073723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 653/1287] 10.222.0.78 () {56 vars in 1374 bytes} [Mon Jul 4 10:00:01 2022] GET /identity/v3/role_assignments?user.id=3fe12b3ec01547eba1493e7a179c8af9&scope.project.id=2cd1740dc99442498a29fabcc4aa8bb8&role.id=751630036fa149ecb8a57e9a6c98cca9 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:04.118436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee8ff3-8a56-4eac-9322-34dce400e489 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:04.118996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee8ff3-8a56-4eac-9322-34dce400e489 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:04.118996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee8ff3-8a56-4eac-9322-34dce400e489 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:04.120382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 635/1288] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:00:04.125638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301867-64dd-40a6-b14c-3135fb7d722c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:04.126062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301867-64dd-40a6-b14c-3135fb7d722c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:04.126203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35301867-64dd-40a6-b14c-3135fb7d722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:04.143250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-35301867-64dd-40a6-b14c-3135fb7d722c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:00:04.144467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-35301867-64dd-40a6-b14c-3135fb7d722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:00:04.173758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:04.210854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 654/1289] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:00:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 10:00:04.233539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee8ff3-8a56-4eac-9322-34dce400e489 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:04.344039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee8ff3-8a56-4eac-9322-34dce400e489 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:04.354478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:04.377412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:04.378149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:04.378432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:04.378709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:04.379358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:04.380752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:04.392955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:04.394326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:04.395525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 636/1290] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 10:00:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:04.400670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301867-64dd-40a6-b14c-3135fb7d722c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:04.496303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35301867-64dd-40a6-b14c-3135fb7d722c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:04.529651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b771b-dc00-4056-af7b-e38916f1085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:04.530306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b771b-dc00-4056-af7b-e38916f1085b None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:04.530589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b771b-dc00-4056-af7b-e38916f1085b None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:04.530862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b771b-dc00-4056-af7b-e38916f1085b None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:04.531600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b771b-dc00-4056-af7b-e38916f1085b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:04.531906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b771b-dc00-4056-af7b-e38916f1085b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:04.533268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b771b-dc00-4056-af7b-e38916f1085b None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:04.538037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 655/1291] 10.222.0.78 () {56 vars in 1116 bytes} [Mon Jul 4 10:00:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:04.544301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:04.643033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a95fb-a730-4a4f-a0e1-3e85260db477 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:04.677026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ccaec-6916-4d2e-bb60-56d7307d245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:04.677685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ccaec-6916-4d2e-bb60-56d7307d245b None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:04.677975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ccaec-6916-4d2e-bb60-56d7307d245b None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:04.678255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ccaec-6916-4d2e-bb60-56d7307d245b None admin] PATH_INFO: `/v3/services` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:04.678967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ccaec-6916-4d2e-bb60-56d7307d245b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:04.679276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ccaec-6916-4d2e-bb60-56d7307d245b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:04.680712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ccaec-6916-4d2e-bb60-56d7307d245b None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:04.685175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 637/1292] 10.222.0.78 () {56 vars in 1116 bytes} [Mon Jul 4 10:00:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:06.738810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e01c-8626-47d4-bfda-84dd3af507c3 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:06.739334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e01c-8626-47d4-bfda-84dd3af507c3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:06.739422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e01c-8626-47d4-bfda-84dd3af507c3 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:06.740796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 656/1293] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:00:06.746450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737311c0-400f-4c31-829c-983ae2410cc1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:06.746836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737311c0-400f-4c31-829c-983ae2410cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:06.747015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737311c0-400f-4c31-829c-983ae2410cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:06.763392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-737311c0-400f-4c31-829c-983ae2410cc1 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:00:06.764623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-737311c0-400f-4c31-829c-983ae2410cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:00:06.793543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:06.831283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 638/1294] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:00:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 10:00:06.854781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e01c-8626-47d4-bfda-84dd3af507c3 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:06.884640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:06.953730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e01c-8626-47d4-bfda-84dd3af507c3 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:06.986558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fdea5-65fa-43a4-82a3-9433aa376d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:06.987209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fdea5-65fa-43a4-82a3-9433aa376d62 None admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:06.987488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fdea5-65fa-43a4-82a3-9433aa376d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:06.987787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fdea5-65fa-43a4-82a3-9433aa376d62 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:06.988508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fdea5-65fa-43a4-82a3-9433aa376d62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:06.989856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fdea5-65fa-43a4-82a3-9433aa376d62 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:07.002888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 657/1295] 10.222.0.78 () {60 vars in 1141 bytes} [Mon Jul 4 10:00:06 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:00:09.004852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c7fd-f28a-4f4c-92a5-971e83a6050c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:09.005408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c7fd-f28a-4f4c-92a5-971e83a6050c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:09.005408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c7fd-f28a-4f4c-92a5-971e83a6050c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:09.006793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 639/1296] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:00:09.011812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde024f-995d-455c-9ed2-0c5c3a3f202c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:09.012217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde024f-995d-455c-9ed2-0c5c3a3f202c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:09.012361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde024f-995d-455c-9ed2-0c5c3a3f202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:09.028707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3dde024f-995d-455c-9ed2-0c5c3a3f202c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:00:09.029890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3dde024f-995d-455c-9ed2-0c5c3a3f202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:00:09.100711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 658/1297] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:00:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 10:00:09.123993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c7fd-f28a-4f4c-92a5-971e83a6050c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:09.224465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c7fd-f28a-4f4c-92a5-971e83a6050c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:09.258876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:09.259673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:09.259965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:09.260276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:09.261008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:09.262525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:09.275535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:09.276758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:09.277633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 640/1298] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 10:00:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:09.283371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde024f-995d-455c-9ed2-0c5c3a3f202c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:09.304358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:09.392021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde024f-995d-455c-9ed2-0c5c3a3f202c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:09.425074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:09.425728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:09.426011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:09.426286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:09.426991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:09.427298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:09.428693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:09.434293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 659/1299] 10.222.0.78 () {56 vars in 1116 bytes} [Mon Jul 4 10:00:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:09.440288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:09.471074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:09.541160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65aa36-ffa5-4825-8bce-9d6107550143 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:09.574306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edf414-c3fd-44c5-a2a5-70862d519a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:09.574965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edf414-c3fd-44c5-a2a5-70862d519a3a None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:09.575248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edf414-c3fd-44c5-a2a5-70862d519a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:09.575525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edf414-c3fd-44c5-a2a5-70862d519a3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:09.576341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edf414-c3fd-44c5-a2a5-70862d519a3a None admin] RBAC: Adding query filter params (interface=public, service_id=23a224b70c444b118e53c9e1f69f8f86, region_id=RegionOne) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:09.576650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edf414-c3fd-44c5-a2a5-70862d519a3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:09.578000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edf414-c3fd-44c5-a2a5-70862d519a3a None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:09.583081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 641/1300] 10.222.0.78 () {56 vars in 1251 bytes} [Mon Jul 4 10:00:09 2022] GET /identity/v3/endpoints?service_id=23a224b70c444b118e53c9e1f69f8f86&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:09.588687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:09.668008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:09.686595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f38e-e9df-448c-9257-8c06027190b5 None admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:09.720225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6205b18-ef3b-4c56-92fd-0a556580374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:09.720879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6205b18-ef3b-4c56-92fd-0a556580374f None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:09.721162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6205b18-ef3b-4c56-92fd-0a556580374f None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:09.721437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6205b18-ef3b-4c56-92fd-0a556580374f None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:09.722113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6205b18-ef3b-4c56-92fd-0a556580374f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:09.723487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6205b18-ef3b-4c56-92fd-0a556580374f None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:09.730707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 660/1301] 10.222.0.78 () {56 vars in 1087 bytes} [Mon Jul 4 10:00:09 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:00:11.753754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64879-2cff-48ff-977f-abc265215401 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:11.754302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64879-2cff-48ff-977f-abc265215401 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:11.754302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64879-2cff-48ff-977f-abc265215401 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:11.755842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 642/1302] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:00:11.760962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a07-2fa3-4caf-97ec-315736c4ae12 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:11.761345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a07-2fa3-4caf-97ec-315736c4ae12 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:11.761519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a07-2fa3-4caf-97ec-315736c4ae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:11.777392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7d3f2a07-2fa3-4caf-97ec-315736c4ae12 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:00:11.778564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7d3f2a07-2fa3-4caf-97ec-315736c4ae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:00:11.845267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 661/1303] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:00:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 10:00:11.868640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c64879-2cff-48ff-977f-abc265215401 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:11.962036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:11.969104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c64879-2cff-48ff-977f-abc265215401 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:12.003736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:12.004528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:12.004814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:12.005091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:12.005745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:12.007117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 10:00:12.021081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 10:00:12.022356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application with Lock( Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self._enter() Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application return self.creator() Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application created_value = creator( Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: ERROR keystone.server.flask.application Jul 04 10:00:12.023531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 643/1304] 10.222.0.78 () {56 vars in 1117 bytes} [Mon Jul 4 10:00:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 10:00:12.029540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2a07-2fa3-4caf-97ec-315736c4ae12 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:12.105211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:12.127796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2a07-2fa3-4caf-97ec-315736c4ae12 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:12.160587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c5ea8-f92f-4c16-9f6b-17ccac58dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:12.161250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c5ea8-f92f-4c16-9f6b-17ccac58dd40 None admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:12.161533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c5ea8-f92f-4c16-9f6b-17ccac58dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:12.161808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c5ea8-f92f-4c16-9f6b-17ccac58dd40 None admin] PATH_INFO: `/v3/services` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:12.162509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c5ea8-f92f-4c16-9f6b-17ccac58dd40 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:00:12.162817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c5ea8-f92f-4c16-9f6b-17ccac58dd40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:12.164830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c5ea8-f92f-4c16-9f6b-17ccac58dd40 None admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:12.169936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 662/1305] 10.222.0.78 () {56 vars in 1116 bytes} [Mon Jul 4 10:00:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:00:12.175960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:00:12.275453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f8814-cc2b-4dbc-b89c-b008f08f4981 None admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:00:12.311511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43956641-a581-45f4-8df5-a3746702d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:00:12.312418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43956641-a581-45f4-8df5-a3746702d593 None admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:00:12.312707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43956641-a581-45f4-8df5-a3746702d593 None admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:00:12.312989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43956641-a581-45f4-8df5-a3746702d593 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:00:12.313743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43956641-a581-45f4-8df5-a3746702d593 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:00:12.315114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43956641-a581-45f4-8df5-a3746702d593 None admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:00:12.333754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 644/1306] 10.222.0.78 () {60 vars in 1144 bytes} [Mon Jul 4 10:00:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:00:22.166966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=30 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:00:22.329808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:15.178292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d02a7-9b57-4a02-a94f-a450bed4112d None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:15.178824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d02a7-9b57-4a02-a94f-a450bed4112d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:15.179283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d02a7-9b57-4a02-a94f-a450bed4112d None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:15.186290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13317-1bad-43f4-931e-4056fc35b5cc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:15.186701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13317-1bad-43f4-931e-4056fc35b5cc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:15.186871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b13317-1bad-43f4-931e-4056fc35b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:15.190617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 663/1307] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:15 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:15.273550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d1b13317-1bad-43f4-931e-4056fc35b5cc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:15.274763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d1b13317-1bad-43f4-931e-4056fc35b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:15.412031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 645/1308] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:15.451688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032065b-5545-4088-b4db-954639275d50 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:15.452734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032065b-5545-4088-b4db-954639275d50 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:15.453753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032065b-5545-4088-b4db-954639275d50 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:15.458663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 664/1309] 10.222.0.78 () {54 vars in 964 bytes} [Mon Jul 4 10:01:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:15.465458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc1d7c-59a9-4872-97b1-8a9ec8f73c7a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:15.465756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc1d7c-59a9-4872-97b1-8a9ec8f73c7a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:15.466058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc1d7c-59a9-4872-97b1-8a9ec8f73c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:15.558913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-45cc1d7c-59a9-4872-97b1-8a9ec8f73c7a None None] MFA Rules not processed for user `a5b5399fad924cabaf1d414bbca2c191`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:15.558913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-45cc1d7c-59a9-4872-97b1-8a9ec8f73c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:15.585662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:15.655161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 646/1310] 10.222.0.78 () {58 vars in 1061 bytes} [Mon Jul 4 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:15.664808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032065b-5545-4088-b4db-954639275d50 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:15.666616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5032065b-5545-4088-b4db-954639275d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:15.782151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032065b-5545-4088-b4db-954639275d50 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:15.861453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89c009-03fd-477c-8025-fdf044c7f39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:15.862116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89c009-03fd-477c-8025-fdf044c7f39f service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:15.862404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89c009-03fd-477c-8025-fdf044c7f39f service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:15.862685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89c009-03fd-477c-8025-fdf044c7f39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:15.865164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9a89c009-03fd-477c-8025-fdf044c7f39f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:15.928936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:15.988284 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89c009-03fd-477c-8025-fdf044c7f39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:15.990300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89c009-03fd-477c-8025-fdf044c7f39f service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:16.010312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 665/1311] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:18.373318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993ef0-cfe8-44e1-a267-868cda83b393 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:18.373902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993ef0-cfe8-44e1-a267-868cda83b393 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:18.373902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993ef0-cfe8-44e1-a267-868cda83b393 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:18.375307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 647/1312] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:18.380653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f55f-2cf1-4a78-8a95-d64db936df73 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:18.381168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f55f-2cf1-4a78-8a95-d64db936df73 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:18.381320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f55f-2cf1-4a78-8a95-d64db936df73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:18.461632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-77b9f55f-2cf1-4a78-8a95-d64db936df73 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:18.462989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-77b9f55f-2cf1-4a78-8a95-d64db936df73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:18.579442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 666/1313] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:18.619467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993ef0-cfe8-44e1-a267-868cda83b393 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:18.621103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-93993ef0-cfe8-44e1-a267-868cda83b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:18.737080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993ef0-cfe8-44e1-a267-868cda83b393 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:18.816199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:18.818944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca9743-0656-46f9-bc37-b9061ce62e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:18.819758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9743-0656-46f9-bc37-b9061ce62e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:18.820426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9743-0656-46f9-bc37-b9061ce62e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:18.821073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9743-0656-46f9-bc37-b9061ce62e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:18.823568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a3ca9743-0656-46f9-bc37-b9061ce62e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:18.951259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca9743-0656-46f9-bc37-b9061ce62e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:18.953003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca9743-0656-46f9-bc37-b9061ce62e7a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:18.975117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 648/1314] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:21.370482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe35477-681a-4696-908c-1d4160c852e3 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:21.371010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe35477-681a-4696-908c-1d4160c852e3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:21.371010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe35477-681a-4696-908c-1d4160c852e3 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:21.372381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 667/1315] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:21.377413 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ce03-1ec5-45dd-81da-83a05ffeb6a8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:21.377819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ce03-1ec5-45dd-81da-83a05ffeb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:21.378009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ce03-1ec5-45dd-81da-83a05ffeb6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:21.447621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0652ce03-1ec5-45dd-81da-83a05ffeb6a8 None None] MFA Rules not processed for user `bc2accf2ac544cc5afff8334e1ed9311`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:21.448866 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0652ce03-1ec5-45dd-81da-83a05ffeb6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:21.510830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:21.555167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 649/1316] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:21.596944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe35477-681a-4696-908c-1d4160c852e3 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:21.598603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3fe35477-681a-4696-908c-1d4160c852e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:21.608429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:21.702167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe35477-681a-4696-908c-1d4160c852e3 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:21.773412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0f5f8-d079-4e6d-87c0-2e540be32be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:21.774059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0f5f8-d079-4e6d-87c0-2e540be32be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:21.774341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0f5f8-d079-4e6d-87c0-2e540be32be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:21.774616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0f5f8-d079-4e6d-87c0-2e540be32be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:21.776293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-43b0f5f8-d079-4e6d-87c0-2e540be32be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:21.837932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:21.884146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0f5f8-d079-4e6d-87c0-2e540be32be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:21.885577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0f5f8-d079-4e6d-87c0-2e540be32be3 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:21.903995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 668/1317] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:24.462435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d168b1-2da2-434c-a11b-eef805aec02e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:24.462991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d168b1-2da2-434c-a11b-eef805aec02e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:24.463101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d168b1-2da2-434c-a11b-eef805aec02e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:24.464418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 650/1318] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:24.469604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fad256-6177-49b6-aaf5-f29fc1553deb None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:24.470001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fad256-6177-49b6-aaf5-f29fc1553deb None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:24.470174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fad256-6177-49b6-aaf5-f29fc1553deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:24.536103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-87fad256-6177-49b6-aaf5-f29fc1553deb None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:24.537306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-87fad256-6177-49b6-aaf5-f29fc1553deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:24.633015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 669/1319] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:24.671921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d168b1-2da2-434c-a11b-eef805aec02e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:24.673457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a6d168b1-2da2-434c-a11b-eef805aec02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:24.779681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d168b1-2da2-434c-a11b-eef805aec02e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:24.853889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a22a7-e216-4e9b-be5b-9f4bb1309ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:24.854535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a22a7-e216-4e9b-be5b-9f4bb1309ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:24.854818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a22a7-e216-4e9b-be5b-9f4bb1309ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:24.855092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a22a7-e216-4e9b-be5b-9f4bb1309ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:24.856765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-582a22a7-e216-4e9b-be5b-9f4bb1309ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:24.864187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:24.964753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a22a7-e216-4e9b-be5b-9f4bb1309ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:24.966186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a22a7-e216-4e9b-be5b-9f4bb1309ccf service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:24.984880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 651/1320] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:27.682060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55528-3141-4b75-8a6e-0d8cccd12c7a None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:27.682586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55528-3141-4b75-8a6e-0d8cccd12c7a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:27.682586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c55528-3141-4b75-8a6e-0d8cccd12c7a None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:27.684033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 670/1321] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:27.689216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc4b2-ec3d-4058-92bf-8a9a7916172e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:27.689634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc4b2-ec3d-4058-92bf-8a9a7916172e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:27.689781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc4b2-ec3d-4058-92bf-8a9a7916172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:27.757033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-347fc4b2-ec3d-4058-92bf-8a9a7916172e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:27.758241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-347fc4b2-ec3d-4058-92bf-8a9a7916172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:27.821166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:27.869901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 652/1322] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:27.919939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966266a-4771-4c6d-957d-af65388cc4ca None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:27.920509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966266a-4771-4c6d-957d-af65388cc4ca None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:27.920782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966266a-4771-4c6d-957d-af65388cc4ca None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:27.922208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 671/1323] 10.222.0.78 () {54 vars in 964 bytes} [Mon Jul 4 10:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:27.928510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f75b-51fe-4f62-b5c2-70811d2dd5d3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:27.929167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f75b-51fe-4f62-b5c2-70811d2dd5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:27.929167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f75b-51fe-4f62-b5c2-70811d2dd5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:28.010644 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fb59f75b-51fe-4f62-b5c2-70811d2dd5d3 None None] MFA Rules not processed for user `a5b5399fad924cabaf1d414bbca2c191`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:28.011923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fb59f75b-51fe-4f62-b5c2-70811d2dd5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:28.091434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 653/1324] 10.222.0.78 () {58 vars in 1061 bytes} [Mon Jul 4 10:01:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:28.101190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966266a-4771-4c6d-957d-af65388cc4ca None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:28.102726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a966266a-4771-4c6d-957d-af65388cc4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:28.122190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:28.207740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966266a-4771-4c6d-957d-af65388cc4ca None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:28.281175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abfef-ddb3-486c-8fc8-b1c985d1fe5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:28.281751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abfef-ddb3-486c-8fc8-b1c985d1fe5e service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:28.282030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abfef-ddb3-486c-8fc8-b1c985d1fe5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:28.282302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abfef-ddb3-486c-8fc8-b1c985d1fe5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:28.283963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-168abfef-ddb3-486c-8fc8-b1c985d1fe5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:28.356891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:28.395399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abfef-ddb3-486c-8fc8-b1c985d1fe5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:28.396806 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abfef-ddb3-486c-8fc8-b1c985d1fe5e service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:28.417737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 672/1325] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:30.725422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c0de-706c-4332-8d46-cb050bc9faaa None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:30.725997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c0de-706c-4332-8d46-cb050bc9faaa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:30.725997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c0de-706c-4332-8d46-cb050bc9faaa None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:30.727376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 654/1326] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:30.732970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2333-ecfd-4411-be48-34b9764dd257 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:30.733466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2333-ecfd-4411-be48-34b9764dd257 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:30.733564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2333-ecfd-4411-be48-34b9764dd257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:30.803290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-94cd2333-ecfd-4411-be48-34b9764dd257 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:30.804532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-94cd2333-ecfd-4411-be48-34b9764dd257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:30.900328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 673/1327] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:30.942196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9c0de-706c-4332-8d46-cb050bc9faaa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:30.943759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-64e9c0de-706c-4332-8d46-cb050bc9faaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:31.008143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:31.051546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9c0de-706c-4332-8d46-cb050bc9faaa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:31.126523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a565-eb8e-478a-ba13-091d5611e09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:31.127184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a565-eb8e-478a-ba13-091d5611e09a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:31.127471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a565-eb8e-478a-ba13-091d5611e09a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:31.127788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a565-eb8e-478a-ba13-091d5611e09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:31.130071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9607a565-eb8e-478a-ba13-091d5611e09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:31.246551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:31.249735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a565-eb8e-478a-ba13-091d5611e09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:31.251674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a565-eb8e-478a-ba13-091d5611e09a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:31.273093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 655/1328] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:01:33.376831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19c83-e7ab-41b2-968c-c7716b7aede8 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:33.377369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19c83-e7ab-41b2-968c-c7716b7aede8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:33.377369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19c83-e7ab-41b2-968c-c7716b7aede8 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:33.379411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 674/1329] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:33.384733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2c5ca-f302-42e0-ac14-ed653c89d667 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:33.385197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2c5ca-f302-42e0-ac14-ed653c89d667 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:33.385303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2c5ca-f302-42e0-ac14-ed653c89d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:33.458245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6ad2c5ca-f302-42e0-ac14-ed653c89d667 None None] MFA Rules not processed for user `bc2accf2ac544cc5afff8334e1ed9311`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:33.459485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6ad2c5ca-f302-42e0-ac14-ed653c89d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:33.583321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 656/1330] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:33.618129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19c83-e7ab-41b2-968c-c7716b7aede8 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:33.619719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-fac19c83-e7ab-41b2-968c-c7716b7aede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:33.656019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:33.728522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19c83-e7ab-41b2-968c-c7716b7aede8 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:33.802970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766ddba-0731-4469-bd81-9cb5db238866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:33.803557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ddba-0731-4469-bd81-9cb5db238866 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:33.803871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ddba-0731-4469-bd81-9cb5db238866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:33.804151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766ddba-0731-4469-bd81-9cb5db238866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:33.805968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7766ddba-0731-4469-bd81-9cb5db238866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:33.882916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:33.916193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766ddba-0731-4469-bd81-9cb5db238866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:33.917633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766ddba-0731-4469-bd81-9cb5db238866 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:33.936392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 675/1331] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:36.370992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6224805-6e7e-4322-8faf-4d5f9464b224 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:36.371566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6224805-6e7e-4322-8faf-4d5f9464b224 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:36.371566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6224805-6e7e-4322-8faf-4d5f9464b224 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:36.373023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 657/1332] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:36.378299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691006ff-1c67-41d5-bbaf-5eaab4a98000 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:36.378762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691006ff-1c67-41d5-bbaf-5eaab4a98000 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:36.378888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691006ff-1c67-41d5-bbaf-5eaab4a98000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:36.444598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-691006ff-1c67-41d5-bbaf-5eaab4a98000 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:36.445787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-691006ff-1c67-41d5-bbaf-5eaab4a98000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:36.540073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 676/1333] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:36.575486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6224805-6e7e-4322-8faf-4d5f9464b224 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:36.577074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f6224805-6e7e-4322-8faf-4d5f9464b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:36.647454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:36.682515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6224805-6e7e-4322-8faf-4d5f9464b224 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:36.760682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094acf0-d87d-4b32-a5ef-c97c4aca357f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:36.761346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094acf0-d87d-4b32-a5ef-c97c4aca357f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:36.761634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094acf0-d87d-4b32-a5ef-c97c4aca357f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:36.761915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094acf0-d87d-4b32-a5ef-c97c4aca357f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:36.763662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c094acf0-d87d-4b32-a5ef-c97c4aca357f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:36.882832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094acf0-d87d-4b32-a5ef-c97c4aca357f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:36.884336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094acf0-d87d-4b32-a5ef-c97c4aca357f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:36.894540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:36.903884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 658/1334] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:38.999222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6718-b438-4f0c-9258-ac41d86c802f None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:38.999784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6718-b438-4f0c-9258-ac41d86c802f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:38.999784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6718-b438-4f0c-9258-ac41d86c802f None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:39.001203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 677/1335] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:39.006848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21632ed7-9ddd-47a7-87c6-adba362d0651 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:39.007289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21632ed7-9ddd-47a7-87c6-adba362d0651 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:39.007387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21632ed7-9ddd-47a7-87c6-adba362d0651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:39.072768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-21632ed7-9ddd-47a7-87c6-adba362d0651 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:39.073974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-21632ed7-9ddd-47a7-87c6-adba362d0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:39.168739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 659/1336] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:39.209225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6718-b438-4f0c-9258-ac41d86c802f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:39.210762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c5cf6718-b438-4f0c-9258-ac41d86c802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:39.250249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:39.314537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6718-b438-4f0c-9258-ac41d86c802f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:39.385935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec8cdb-9e8f-4a83-87bc-68c95bff53a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:39.386611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec8cdb-9e8f-4a83-87bc-68c95bff53a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:39.386898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec8cdb-9e8f-4a83-87bc-68c95bff53a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:39.387178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec8cdb-9e8f-4a83-87bc-68c95bff53a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:39.388863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7bec8cdb-9e8f-4a83-87bc-68c95bff53a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:39.469683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:39.495817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec8cdb-9e8f-4a83-87bc-68c95bff53a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:39.497251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec8cdb-9e8f-4a83-87bc-68c95bff53a5 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:39.515507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 678/1337] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:41.855476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac08d6-22af-4b62-86e0-078833cb4d2b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:41.856058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac08d6-22af-4b62-86e0-078833cb4d2b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:41.856058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac08d6-22af-4b62-86e0-078833cb4d2b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:41.857406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 660/1338] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:41.864003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e6296-f281-4c77-b9ce-4299e731194a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:41.864517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e6296-f281-4c77-b9ce-4299e731194a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:41.864644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e6296-f281-4c77-b9ce-4299e731194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:41.930410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ae3e6296-f281-4c77-b9ce-4299e731194a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:41.931653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ae3e6296-f281-4c77-b9ce-4299e731194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:42.033550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 679/1339] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:42.071997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac08d6-22af-4b62-86e0-078833cb4d2b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:42.073548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bbac08d6-22af-4b62-86e0-078833cb4d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:42.153133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:42.181771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac08d6-22af-4b62-86e0-078833cb4d2b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:42.255417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1f4b4-5d4a-483d-9209-5cc4ef00b0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:42.256092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f4b4-5d4a-483d-9209-5cc4ef00b0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:42.256380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f4b4-5d4a-483d-9209-5cc4ef00b0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:42.256658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f4b4-5d4a-483d-9209-5cc4ef00b0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:42.258309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c8d1f4b4-5d4a-483d-9209-5cc4ef00b0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:42.373466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1f4b4-5d4a-483d-9209-5cc4ef00b0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:42.374898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1f4b4-5d4a-483d-9209-5cc4ef00b0e5 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:42.393869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 661/1340] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:46.383348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffcab-74e7-4663-8bfa-be13da6ac682 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:46.383961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffcab-74e7-4663-8bfa-be13da6ac682 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:46.383961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffcab-74e7-4663-8bfa-be13da6ac682 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:46.385354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 680/1341] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:46.392691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1f37-02b2-4a3e-8582-f9ed6af09e8e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:46.393192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1f37-02b2-4a3e-8582-f9ed6af09e8e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:46.393804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1f37-02b2-4a3e-8582-f9ed6af09e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:46.400194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:46.488174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-43ab1f37-02b2-4a3e-8582-f9ed6af09e8e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:46.489713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-43ab1f37-02b2-4a3e-8582-f9ed6af09e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:46.624572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 662/1342] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:46.667184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffcab-74e7-4663-8bfa-be13da6ac682 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:46.669381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8c5ffcab-74e7-4663-8bfa-be13da6ac682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:46.726250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:46.772545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffcab-74e7-4663-8bfa-be13da6ac682 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:46.776112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048be3d4-b50d-4e9f-b98f-ceaeada88da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:46.776758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be3d4-b50d-4e9f-b98f-ceaeada88da7 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:46.777038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be3d4-b50d-4e9f-b98f-ceaeada88da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:46.777309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048be3d4-b50d-4e9f-b98f-ceaeada88da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:46.787921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048be3d4-b50d-4e9f-b98f-ceaeada88da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:46.789425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048be3d4-b50d-4e9f-b98f-ceaeada88da7 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:46.801444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 681/1343] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:49.685015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740bf1-5e9c-4855-9f81-6e6479ce1779 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:49.685551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740bf1-5e9c-4855-9f81-6e6479ce1779 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:49.685551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740bf1-5e9c-4855-9f81-6e6479ce1779 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:49.686974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 663/1344] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 10:01:49.693533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dd841-2d99-4ed4-880a-61b24e73e6b0 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:49.694126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dd841-2d99-4ed4-880a-61b24e73e6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:49.694231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dd841-2d99-4ed4-880a-61b24e73e6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:49.723436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-794dd841-2d99-4ed4-880a-61b24e73e6b0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:49.724691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-794dd841-2d99-4ed4-880a-61b24e73e6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:49.810266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 682/1345] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:49.848751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57740bf1-5e9c-4855-9f81-6e6479ce1779 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:49.850490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-57740bf1-5e9c-4855-9f81-6e6479ce1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:49.863260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57740bf1-5e9c-4855-9f81-6e6479ce1779 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:49.866795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348d969-f607-4b35-8161-2289a35e7479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:49.867436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d969-f607-4b35-8161-2289a35e7479 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:49.867753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d969-f607-4b35-8161-2289a35e7479 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:49.868032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348d969-f607-4b35-8161-2289a35e7479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:49.877156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348d969-f607-4b35-8161-2289a35e7479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:49.878622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348d969-f607-4b35-8161-2289a35e7479 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:49.888452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 664/1346] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:54.007602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e540bc-62b8-4f81-909e-1bef63308f80 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:54.008165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e540bc-62b8-4f81-909e-1bef63308f80 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:54.008165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e540bc-62b8-4f81-909e-1bef63308f80 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:54.009622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 683/1347] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:54.017015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d64d2-ae92-4eaa-aa5c-4c5b66ce4b9d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:54.017636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d64d2-ae92-4eaa-aa5c-4c5b66ce4b9d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:54.017636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d64d2-ae92-4eaa-aa5c-4c5b66ce4b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:54.036844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a95d64d2-ae92-4eaa-aa5c-4c5b66ce4b9d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:54.038089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a95d64d2-ae92-4eaa-aa5c-4c5b66ce4b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:54.047023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 665/1348] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:01:54.086941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e540bc-62b8-4f81-909e-1bef63308f80 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:01:54.098362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e540bc-62b8-4f81-909e-1bef63308f80 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:01:54.101923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215e0aa-ebfb-4009-a373-353380cf916d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:01:54.102564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e0aa-ebfb-4009-a373-353380cf916d service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:54.102847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e0aa-ebfb-4009-a373-353380cf916d service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:54.103125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e0aa-ebfb-4009-a373-353380cf916d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:54.112404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e0aa-ebfb-4009-a373-353380cf916d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:01:54.113841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e0aa-ebfb-4009-a373-353380cf916d service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:01:54.124315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 684/1349] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:01:59.168999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779169-05d3-4cdf-b72c-1e0a803ed7fa None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:59.169804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779169-05d3-4cdf-b72c-1e0a803ed7fa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:59.169804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779169-05d3-4cdf-b72c-1e0a803ed7fa None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:59.171283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 666/1350] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:01:59.176473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760da9d-f81c-4848-9cb2-bc47c658bf9c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:01:59.176913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760da9d-f81c-4848-9cb2-bc47c658bf9c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:01:59.177041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760da9d-f81c-4848-9cb2-bc47c658bf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:01:59.256991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3760da9d-f81c-4848-9cb2-bc47c658bf9c None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:01:59.258285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3760da9d-f81c-4848-9cb2-bc47c658bf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:01:59.287999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:01:59.352368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 685/1351] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:01:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:03.454188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7a7d9-c167-4e31-a1eb-4e0606b56307 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:03.455328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7a7d9-c167-4e31-a1eb-4e0606b56307 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:03.455328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7a7d9-c167-4e31-a1eb-4e0606b56307 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:03.456998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 667/1352] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:03.462445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497229a0-c243-4e1a-9fd5-e19df19bcd48 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:03.463311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497229a0-c243-4e1a-9fd5-e19df19bcd48 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:03.463849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497229a0-c243-4e1a-9fd5-e19df19bcd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:03.482431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-497229a0-c243-4e1a-9fd5-e19df19bcd48 None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:03.484029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-497229a0-c243-4e1a-9fd5-e19df19bcd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:03.494242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 686/1353] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:02:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:02:04.033510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=72 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:05.123214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1ab7b-f374-4acf-8074-a87bcf091c49 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:05.123915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1ab7b-f374-4acf-8074-a87bcf091c49 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:05.123915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1ab7b-f374-4acf-8074-a87bcf091c49 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:05.125286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 668/1354] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 10:02:05.130405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15cf85-1bb0-43d6-8d77-e139125b2938 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:05.130859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15cf85-1bb0-43d6-8d77-e139125b2938 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:05.131103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15cf85-1bb0-43d6-8d77-e139125b2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:05.149860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ca15cf85-1bb0-43d6-8d77-e139125b2938 None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:05.151151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ca15cf85-1bb0-43d6-8d77-e139125b2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:05.160473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 687/1355] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:02:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:08.750895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702863f-4b5d-41aa-a622-63d4c7f83d6e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:08.753359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702863f-4b5d-41aa-a622-63d4c7f83d6e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:08.753798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702863f-4b5d-41aa-a622-63d4c7f83d6e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:08.759551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 669/1356] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:08.761517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23fb71-8b4e-482e-be5d-6cca9ca97df7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:08.761969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23fb71-8b4e-482e-be5d-6cca9ca97df7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:08.762085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23fb71-8b4e-482e-be5d-6cca9ca97df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:08.783397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3f23fb71-8b4e-482e-be5d-6cca9ca97df7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:08.784909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3f23fb71-8b4e-482e-be5d-6cca9ca97df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:08.793052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 688/1357] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:08.848373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd0f6-8263-44b5-b9a4-f5323a57bebb None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:08.849057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd0f6-8263-44b5-b9a4-f5323a57bebb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:08.849497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd0f6-8263-44b5-b9a4-f5323a57bebb None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:08.851250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 670/1358] 10.222.0.78 () {54 vars in 961 bytes} [Mon Jul 4 10:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:08.864964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11303b-e7ea-443f-8592-32f64ff6240e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:08.866826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11303b-e7ea-443f-8592-32f64ff6240e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:08.867377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11303b-e7ea-443f-8592-32f64ff6240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:08.920866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-aa11303b-e7ea-443f-8592-32f64ff6240e None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:08.922041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-aa11303b-e7ea-443f-8592-32f64ff6240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:09.011769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 689/1359] 10.222.0.78 () {58 vars in 1058 bytes} [Mon Jul 4 10:02:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:09.023100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafd0f6-8263-44b5-b9a4-f5323a57bebb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:09.039100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafd0f6-8263-44b5-b9a4-f5323a57bebb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:09.044960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47352b51-acfe-465b-b6c1-1ad3bfa0c5a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:09.045606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352b51-acfe-465b-b6c1-1ad3bfa0c5a7 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:09.045890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352b51-acfe-465b-b6c1-1ad3bfa0c5a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:09.046167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47352b51-acfe-465b-b6c1-1ad3bfa0c5a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:09.055780 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47352b51-acfe-465b-b6c1-1ad3bfa0c5a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:09.057377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47352b51-acfe-465b-b6c1-1ad3bfa0c5a7 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:09.068113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 671/1360] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:11.323494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57e98-2c08-4668-9e50-94008f5ab895 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:11.324065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57e98-2c08-4668-9e50-94008f5ab895 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:11.324065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57e98-2c08-4668-9e50-94008f5ab895 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:11.325632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 690/1361] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:11.331209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2b58e-5eac-4742-b0cf-819f347dd86f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:11.332699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2b58e-5eac-4742-b0cf-819f347dd86f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:11.333131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2b58e-5eac-4742-b0cf-819f347dd86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:11.354384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-18f2b58e-5eac-4742-b0cf-819f347dd86f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:11.356527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-18f2b58e-5eac-4742-b0cf-819f347dd86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:11.368209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 672/1362] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:11.412767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57e98-2c08-4668-9e50-94008f5ab895 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:11.430682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57e98-2c08-4668-9e50-94008f5ab895 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:11.436681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da85bc-cfed-4953-9be1-b2f591b519b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:11.437452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da85bc-cfed-4953-9be1-b2f591b519b3 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:11.437839 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da85bc-cfed-4953-9be1-b2f591b519b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:11.438319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da85bc-cfed-4953-9be1-b2f591b519b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:11.449119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da85bc-cfed-4953-9be1-b2f591b519b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:11.451195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da85bc-cfed-4953-9be1-b2f591b519b3 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:11.462192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 691/1363] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:13.816543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c29da-0324-4928-87df-77287a1bd442 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:13.817035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c29da-0324-4928-87df-77287a1bd442 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:13.817124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c29da-0324-4928-87df-77287a1bd442 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:13.818840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 673/1364] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 10:02:13.824115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158457-4b72-43ac-a972-baa124a65828 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:13.824914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158457-4b72-43ac-a972-baa124a65828 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:13.825434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158457-4b72-43ac-a972-baa124a65828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:13.846108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-00158457-4b72-43ac-a972-baa124a65828 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:13.847400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-00158457-4b72-43ac-a972-baa124a65828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:13.870840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 692/1365] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:13.914985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470989c2-85da-412c-8469-bfa967d0413c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:13.915272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470989c2-85da-412c-8469-bfa967d0413c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:13.915554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470989c2-85da-412c-8469-bfa967d0413c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:13.917004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 674/1366] 10.222.0.78 () {54 vars in 961 bytes} [Mon Jul 4 10:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:13.922614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157411c-6d07-4b3b-a3e8-aae0488dee03 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:13.923463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157411c-6d07-4b3b-a3e8-aae0488dee03 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:13.923875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157411c-6d07-4b3b-a3e8-aae0488dee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:13.942934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0157411c-6d07-4b3b-a3e8-aae0488dee03 None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:13.944165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0157411c-6d07-4b3b-a3e8-aae0488dee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:13.953475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 693/1367] 10.222.0.78 () {58 vars in 1058 bytes} [Mon Jul 4 10:02:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:13.961924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470989c2-85da-412c-8469-bfa967d0413c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:13.976746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470989c2-85da-412c-8469-bfa967d0413c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:13.982076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee61f1-4a76-47a9-ad7a-235835f97da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:13.982709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee61f1-4a76-47a9-ad7a-235835f97da7 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:13.982990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee61f1-4a76-47a9-ad7a-235835f97da7 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:13.983263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee61f1-4a76-47a9-ad7a-235835f97da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:13.992165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee61f1-4a76-47a9-ad7a-235835f97da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:13.993749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee61f1-4a76-47a9-ad7a-235835f97da7 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:14.003411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 675/1368] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:16.152750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648386-5ac4-4755-9237-cd84999b01c5 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:16.153328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648386-5ac4-4755-9237-cd84999b01c5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:16.153328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648386-5ac4-4755-9237-cd84999b01c5 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:16.155770 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 694/1369] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:16.161589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ba6d-0457-481f-bbb5-948a01dc6371 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:16.162138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ba6d-0457-481f-bbb5-948a01dc6371 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:16.162138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ba6d-0457-481f-bbb5-948a01dc6371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:16.181710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2488ba6d-0457-481f-bbb5-948a01dc6371 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:16.182963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2488ba6d-0457-481f-bbb5-948a01dc6371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:16.192107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 676/1370] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:16.238068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87648386-5ac4-4755-9237-cd84999b01c5 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:16.253580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87648386-5ac4-4755-9237-cd84999b01c5 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:16.259273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920457d4-2500-40f5-96ad-794e73cb7add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:16.260081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920457d4-2500-40f5-96ad-794e73cb7add service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:16.260462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920457d4-2500-40f5-96ad-794e73cb7add service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:16.261208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920457d4-2500-40f5-96ad-794e73cb7add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:16.271168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920457d4-2500-40f5-96ad-794e73cb7add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:16.273165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920457d4-2500-40f5-96ad-794e73cb7add service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:16.283823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 695/1371] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:16.894269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6101f-998e-4914-b65c-cb0aed30b84b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:16.894791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6101f-998e-4914-b65c-cb0aed30b84b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:16.895223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6101f-998e-4914-b65c-cb0aed30b84b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:16.896766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 677/1372] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:16.901999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9bea1-97f2-467b-a04c-1189fe07fcd4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:16.902422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9bea1-97f2-467b-a04c-1189fe07fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:16.902862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9bea1-97f2-467b-a04c-1189fe07fcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:16.924025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-6ee9bea1-97f2-467b-a04c-1189fe07fcd4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:16.925300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6ee9bea1-97f2-467b-a04c-1189fe07fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:16.934049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 696/1373] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:02:17.291974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd1f9-61fa-4fdb-be8b-e8b42bd7c0a0 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:17.291974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd1f9-61fa-4fdb-be8b-e8b42bd7c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:17.291974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd1f9-61fa-4fdb-be8b-e8b42bd7c0a0 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:17.294934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 678/1374] 10.222.0.78 () {54 vars in 963 bytes} [Mon Jul 4 10:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:17.300847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8df65-bb8b-4ffc-8c9b-b564bbb4be4c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:17.300847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8df65-bb8b-4ffc-8c9b-b564bbb4be4c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:17.300847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8df65-bb8b-4ffc-8c9b-b564bbb4be4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:17.313313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:17.361117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-68b8df65-bb8b-4ffc-8c9b-b564bbb4be4c None None] MFA Rules not processed for user `4d8bee133d6a4583a31c87aa4d4af927`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:17.362327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-68b8df65-bb8b-4ffc-8c9b-b564bbb4be4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:17.432366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 697/1375] 10.222.0.78 () {58 vars in 1060 bytes} [Mon Jul 4 10:02:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:17.444100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd1f9-61fa-4fdb-be8b-e8b42bd7c0a0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:17.456963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd1f9-61fa-4fdb-be8b-e8b42bd7c0a0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:17.460911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2f6f6-e308-45cb-91d1-62d5967d5ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:17.461742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f6f6-e308-45cb-91d1-62d5967d5ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:17.462186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f6f6-e308-45cb-91d1-62d5967d5ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:17.462620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2f6f6-e308-45cb-91d1-62d5967d5ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:17.473297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2f6f6-e308-45cb-91d1-62d5967d5ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:17.474958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2f6f6-e308-45cb-91d1-62d5967d5ca0 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:17.499956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 679/1376] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:18.380270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41853b72-3f9c-49fc-98de-009cd5330069 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:18.380854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41853b72-3f9c-49fc-98de-009cd5330069 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:18.380951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41853b72-3f9c-49fc-98de-009cd5330069 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:18.382423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 698/1377] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:18.387684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d1bc-eddf-43fb-b4a2-72598b0a3c21 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:18.388124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d1bc-eddf-43fb-b4a2-72598b0a3c21 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:18.388425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8d1bc-eddf-43fb-b4a2-72598b0a3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:18.406231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ebb8d1bc-eddf-43fb-b4a2-72598b0a3c21 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:18.408025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ebb8d1bc-eddf-43fb-b4a2-72598b0a3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:18.416589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 680/1378] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:18.462244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41853b72-3f9c-49fc-98de-009cd5330069 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:18.476441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41853b72-3f9c-49fc-98de-009cd5330069 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:18.481843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db446f-431b-4161-bd57-c28c00d2b314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:18.482478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db446f-431b-4161-bd57-c28c00d2b314 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:18.482760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db446f-431b-4161-bd57-c28c00d2b314 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:18.483036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db446f-431b-4161-bd57-c28c00d2b314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:18.491163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db446f-431b-4161-bd57-c28c00d2b314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:18.492787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db446f-431b-4161-bd57-c28c00d2b314 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:18.503050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 699/1379] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:20.555034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263f3c-9c51-41ac-887f-edd6e6c51b62 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:20.555882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263f3c-9c51-41ac-887f-edd6e6c51b62 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:20.556315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40263f3c-9c51-41ac-887f-edd6e6c51b62 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:20.558178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 681/1380] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:20.563819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6adb-6eb7-4e7b-8abb-55347b829372 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:20.564613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6adb-6eb7-4e7b-8abb-55347b829372 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:20.565042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6adb-6eb7-4e7b-8abb-55347b829372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:20.589132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0f7c6adb-6eb7-4e7b-8abb-55347b829372 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:20.590345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0f7c6adb-6eb7-4e7b-8abb-55347b829372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:20.599063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 700/1381] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:20.644187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40263f3c-9c51-41ac-887f-edd6e6c51b62 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:20.659510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40263f3c-9c51-41ac-887f-edd6e6c51b62 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:20.665027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1216fb9-886e-4120-b316-5017d0c366f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:20.665675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216fb9-886e-4120-b316-5017d0c366f6 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:20.665962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216fb9-886e-4120-b316-5017d0c366f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:20.666242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216fb9-886e-4120-b316-5017d0c366f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:20.674875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1216fb9-886e-4120-b316-5017d0c366f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:20.676487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1216fb9-886e-4120-b316-5017d0c366f6 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:20.686056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 682/1382] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:22.804301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac597-1902-4aa9-aaf8-ffc1c5fbcbac None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:22.804822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac597-1902-4aa9-aaf8-ffc1c5fbcbac None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:22.804936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac597-1902-4aa9-aaf8-ffc1c5fbcbac None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:22.806226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 701/1383] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:22.811302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7735e-cede-4d05-ae3d-4267cbaf3232 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:22.811725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7735e-cede-4d05-ae3d-4267cbaf3232 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:22.811883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7735e-cede-4d05-ae3d-4267cbaf3232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:22.830784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-82c7735e-cede-4d05-ae3d-4267cbaf3232 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:22.832244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-82c7735e-cede-4d05-ae3d-4267cbaf3232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:22.840363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 683/1384] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:22.881855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac597-1902-4aa9-aaf8-ffc1c5fbcbac None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:22.896925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac597-1902-4aa9-aaf8-ffc1c5fbcbac None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:22.902743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236413-5a1b-4dc2-8366-e0cfa256a1e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:22.903618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236413-5a1b-4dc2-8366-e0cfa256a1e4 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:22.904112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236413-5a1b-4dc2-8366-e0cfa256a1e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:22.904592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236413-5a1b-4dc2-8366-e0cfa256a1e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:22.914230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6236413-5a1b-4dc2-8366-e0cfa256a1e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:22.916085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6236413-5a1b-4dc2-8366-e0cfa256a1e4 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:22.927460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 702/1385] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:25.016982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382bf-5882-4f7b-9aaf-f1966e1b7d7c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:25.017921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382bf-5882-4f7b-9aaf-f1966e1b7d7c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:25.018797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495382bf-5882-4f7b-9aaf-f1966e1b7d7c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:25.021475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 684/1386] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:25.027369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61aa2-9b20-41e0-91be-6ded08cf5b0e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:25.027981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61aa2-9b20-41e0-91be-6ded08cf5b0e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:25.027981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61aa2-9b20-41e0-91be-6ded08cf5b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:25.048368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1bd61aa2-9b20-41e0-91be-6ded08cf5b0e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:25.049579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1bd61aa2-9b20-41e0-91be-6ded08cf5b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:25.057865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 703/1387] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:25.105017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495382bf-5882-4f7b-9aaf-f1966e1b7d7c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:25.120268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495382bf-5882-4f7b-9aaf-f1966e1b7d7c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:25.126320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439cb32-a95c-4f8c-8d39-886227799ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:25.126960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439cb32-a95c-4f8c-8d39-886227799ccc service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:25.127239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439cb32-a95c-4f8c-8d39-886227799ccc service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:25.127516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439cb32-a95c-4f8c-8d39-886227799ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:25.136141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439cb32-a95c-4f8c-8d39-886227799ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:25.137730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439cb32-a95c-4f8c-8d39-886227799ccc service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:25.150980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 685/1388] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:27.247417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55cfe-0fad-483f-83fc-567c3d1a4476 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:27.248178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55cfe-0fad-483f-83fc-567c3d1a4476 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:27.248178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55cfe-0fad-483f-83fc-567c3d1a4476 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:27.249400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 704/1389] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:27.255262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540ff5-5aea-4823-be1b-c1d893ae5635 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:27.255723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540ff5-5aea-4823-be1b-c1d893ae5635 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:27.256058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540ff5-5aea-4823-be1b-c1d893ae5635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:27.280596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f4540ff5-5aea-4823-be1b-c1d893ae5635 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:27.283131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f4540ff5-5aea-4823-be1b-c1d893ae5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:27.293802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 686/1390] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:27.339342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55cfe-0fad-483f-83fc-567c3d1a4476 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:27.354438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55cfe-0fad-483f-83fc-567c3d1a4476 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:27.360651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742ec04-f75e-480d-96e8-7c5e49863c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:27.361616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ec04-f75e-480d-96e8-7c5e49863c5c service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:27.361924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ec04-f75e-480d-96e8-7c5e49863c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:27.362367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ec04-f75e-480d-96e8-7c5e49863c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:27.374003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742ec04-f75e-480d-96e8-7c5e49863c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:27.376570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742ec04-f75e-480d-96e8-7c5e49863c5c service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:27.389659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 705/1391] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:29.724331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d51baa-f444-405d-9b06-20f14c6c1083 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:29.724915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d51baa-f444-405d-9b06-20f14c6c1083 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:29.724915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d51baa-f444-405d-9b06-20f14c6c1083 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:29.726395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 687/1392] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:29.733349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea73f-80d2-4e0f-8c4e-11ebf37db3d5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:29.733796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea73f-80d2-4e0f-8c4e-11ebf37db3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:29.734081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea73f-80d2-4e0f-8c4e-11ebf37db3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:29.757282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-caaea73f-80d2-4e0f-8c4e-11ebf37db3d5 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:29.758893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-caaea73f-80d2-4e0f-8c4e-11ebf37db3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:29.769597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 706/1393] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:29.826724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d51baa-f444-405d-9b06-20f14c6c1083 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:29.841910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d51baa-f444-405d-9b06-20f14c6c1083 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:29.847555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff23fa-c656-4b18-b1f1-63e5842167be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:29.848263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff23fa-c656-4b18-b1f1-63e5842167be service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:29.848524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff23fa-c656-4b18-b1f1-63e5842167be service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:29.848803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff23fa-c656-4b18-b1f1-63e5842167be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:29.860150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff23fa-c656-4b18-b1f1-63e5842167be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:29.861746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff23fa-c656-4b18-b1f1-63e5842167be service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:29.873146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 688/1394] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:31.943737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564356f-4f39-434a-a84d-85674e730a1f None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:31.944361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564356f-4f39-434a-a84d-85674e730a1f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:31.944361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564356f-4f39-434a-a84d-85674e730a1f None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:31.945692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 707/1395] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:31.950974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7aae-aff1-45f8-9750-374665368f06 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:31.951406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7aae-aff1-45f8-9750-374665368f06 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:31.951685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7aae-aff1-45f8-9750-374665368f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:31.970171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a70f7aae-aff1-45f8-9750-374665368f06 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:31.971361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a70f7aae-aff1-45f8-9750-374665368f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:31.979256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 689/1396] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:32.023215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564356f-4f39-434a-a84d-85674e730a1f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:32.038596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564356f-4f39-434a-a84d-85674e730a1f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:32.044305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a8ae-672f-4172-a2e9-3d821124c505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:32.045061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a8ae-672f-4172-a2e9-3d821124c505 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:32.045347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a8ae-672f-4172-a2e9-3d821124c505 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:32.045627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a8ae-672f-4172-a2e9-3d821124c505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:32.054155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a8ae-672f-4172-a2e9-3d821124c505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:32.055770 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a8ae-672f-4172-a2e9-3d821124c505 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:32.066012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 708/1397] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:32.694438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2f865-66b5-4998-962e-08ea45cb3988 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:32.694730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2f865-66b5-4998-962e-08ea45cb3988 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:32.695011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2f865-66b5-4998-962e-08ea45cb3988 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:32.696486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 690/1398] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:32.702038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af083b-93d1-424b-bb70-79d367fe9ca6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:32.702328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af083b-93d1-424b-bb70-79d367fe9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:32.702608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af083b-93d1-424b-bb70-79d367fe9ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:32.721891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-39af083b-93d1-424b-bb70-79d367fe9ca6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:32.723118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-39af083b-93d1-424b-bb70-79d367fe9ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:32.731427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 709/1399] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:32.786958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55128-2b96-47a4-b82d-b130704cd1ed None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:32.787268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55128-2b96-47a4-b82d-b130704cd1ed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:32.787547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55128-2b96-47a4-b82d-b130704cd1ed None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:32.788959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 691/1400] 10.222.0.78 () {54 vars in 962 bytes} [Mon Jul 4 10:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:32.794453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32f51-260f-430d-a04a-ce3ceba7ddd3 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:32.794746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32f51-260f-430d-a04a-ce3ceba7ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:32.795053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32f51-260f-430d-a04a-ce3ceba7ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:32.842853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5bc32f51-260f-430d-a04a-ce3ceba7ddd3 None None] MFA Rules not processed for user `34e1bd13b2094b93b41f10f209660b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:32.844512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5bc32f51-260f-430d-a04a-ce3ceba7ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:32.877483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:32.905962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 710/1401] 10.222.0.78 () {58 vars in 1059 bytes} [Mon Jul 4 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:32.913467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55128-2b96-47a4-b82d-b130704cd1ed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:32.924323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55128-2b96-47a4-b82d-b130704cd1ed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:32.927874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed000b4-8afe-49ba-8f95-dfa2d3e4a58c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:32.928513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed000b4-8afe-49ba-8f95-dfa2d3e4a58c service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:32.928799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed000b4-8afe-49ba-8f95-dfa2d3e4a58c service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:32.929077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed000b4-8afe-49ba-8f95-dfa2d3e4a58c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:32.938565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed000b4-8afe-49ba-8f95-dfa2d3e4a58c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:32.940055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed000b4-8afe-49ba-8f95-dfa2d3e4a58c service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:32.949496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 692/1402] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:33.674740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830788d-90bc-411c-ad26-82ddf3d92d2e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:33.675257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830788d-90bc-411c-ad26-82ddf3d92d2e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:33.675451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830788d-90bc-411c-ad26-82ddf3d92d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:33.724834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3830788d-90bc-411c-ad26-82ddf3d92d2e None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:33.726026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3830788d-90bc-411c-ad26-82ddf3d92d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:33.792521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 711/1403] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:02:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:33.838746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408c941-691c-4336-926e-126920c9a7f7 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:33.839312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408c941-691c-4336-926e-126920c9a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:33.839312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408c941-691c-4336-926e-126920c9a7f7 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:33.840768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 693/1404] 10.222.0.78 () {54 vars in 942 bytes} [Mon Jul 4 10:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:33.847749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0389f-1981-46df-924b-538fbf0f1278 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:33.848113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0389f-1981-46df-924b-538fbf0f1278 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:33.848399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0389f-1981-46df-924b-538fbf0f1278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:33.897852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-36c0389f-1981-46df-924b-538fbf0f1278 None None] MFA Rules not processed for user `323dac67dfab4c95b3c1d6ccc9b0a701`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:33.899058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-36c0389f-1981-46df-924b-538fbf0f1278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:33.972488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 712/1405] 10.222.0.78 () {58 vars in 1039 bytes} [Mon Jul 4 10:02:33 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:02:33.982001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408c941-691c-4336-926e-126920c9a7f7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:33.996251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408c941-691c-4336-926e-126920c9a7f7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:34.001998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb228e5-f9c0-4961-a3df-4c26d4dc74b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:34.002768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb228e5-f9c0-4961-a3df-4c26d4dc74b8 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:34.003142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb228e5-f9c0-4961-a3df-4c26d4dc74b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:34.003406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb228e5-f9c0-4961-a3df-4c26d4dc74b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:34.011938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb228e5-f9c0-4961-a3df-4c26d4dc74b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:34.013614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb228e5-f9c0-4961-a3df-4c26d4dc74b8 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:34.022349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 694/1406] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 10:02:34.163012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d285f-04f8-443d-99bf-338d58410aa6 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:34.163338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d285f-04f8-443d-99bf-338d58410aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:34.163605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d285f-04f8-443d-99bf-338d58410aa6 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:34.165136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 713/1407] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:34.170360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549dfdd-c5e7-4397-b2c5-9a7fe96d69d7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:34.170651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549dfdd-c5e7-4397-b2c5-9a7fe96d69d7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:34.170932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549dfdd-c5e7-4397-b2c5-9a7fe96d69d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:34.177736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=67 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:34.193488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d549dfdd-c5e7-4397-b2c5-9a7fe96d69d7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:34.194698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d549dfdd-c5e7-4397-b2c5-9a7fe96d69d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:34.202696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 695/1408] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:34.248796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d285f-04f8-443d-99bf-338d58410aa6 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:34.268610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d285f-04f8-443d-99bf-338d58410aa6 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:34.275305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598c79d-a2dc-4ac2-b2a4-feca3edddd81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:34.276080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598c79d-a2dc-4ac2-b2a4-feca3edddd81 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:34.276361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598c79d-a2dc-4ac2-b2a4-feca3edddd81 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:34.276762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598c79d-a2dc-4ac2-b2a4-feca3edddd81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:34.285869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598c79d-a2dc-4ac2-b2a4-feca3edddd81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:34.287491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598c79d-a2dc-4ac2-b2a4-feca3edddd81 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:34.293173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:34.299512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 714/1409] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:44.186123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:02:56.195370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c66f-7737-4f71-85bf-93dcb1ffe23d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:56.196171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c66f-7737-4f71-85bf-93dcb1ffe23d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:56.196171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c66f-7737-4f71-85bf-93dcb1ffe23d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:56.197392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 696/1410] 10.222.0.78 () {54 vars in 918 bytes} [Mon Jul 4 10:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:56.203016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59914aa4-2977-4989-8e0b-396b0171c824 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:56.203458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59914aa4-2977-4989-8e0b-396b0171c824 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:56.203592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59914aa4-2977-4989-8e0b-396b0171c824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:56.221407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-59914aa4-2977-4989-8e0b-396b0171c824 None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:56.222612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-59914aa4-2977-4989-8e0b-396b0171c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:56.231164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 715/1411] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Jul 4 10:02:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:56.245095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbca53-c18e-425e-a91a-26c5e63bf827 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:56.245392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbca53-c18e-425e-a91a-26c5e63bf827 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:56.245676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbca53-c18e-425e-a91a-26c5e63bf827 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:56.247038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 697/1412] 10.222.0.78 () {54 vars in 918 bytes} [Mon Jul 4 10:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:56.252255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9670f1-2695-4e6b-b810-0019f12fad7b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:56.252585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9670f1-2695-4e6b-b810-0019f12fad7b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:56.252903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9670f1-2695-4e6b-b810-0019f12fad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:56.270960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-af9670f1-2695-4e6b-b810-0019f12fad7b None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:56.272199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-af9670f1-2695-4e6b-b810-0019f12fad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:56.282845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 716/1413] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Jul 4 10:02:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:58.787966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f65943-b608-4709-81a3-31286cf75a1d None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:58.788568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f65943-b608-4709-81a3-31286cf75a1d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:58.788568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f65943-b608-4709-81a3-31286cf75a1d None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:58.789899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:58.795907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad07ea-440b-44dd-9737-9146e215dfcd None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:58.796347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad07ea-440b-44dd-9737-9146e215dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:58.796465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad07ea-440b-44dd-9737-9146e215dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:58.814302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7cad07ea-440b-44dd-9737-9146e215dfcd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:58.815489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7cad07ea-440b-44dd-9737-9146e215dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:58.823208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:58.865830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f65943-b608-4709-81a3-31286cf75a1d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:02:58.880799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f65943-b608-4709-81a3-31286cf75a1d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:02:58.886172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951cb1f-bc15-4ca3-b74b-54b790b6dd50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:02:58.886801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951cb1f-bc15-4ca3-b74b-54b790b6dd50 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:58.887080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951cb1f-bc15-4ca3-b74b-54b790b6dd50 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:58.887351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951cb1f-bc15-4ca3-b74b-54b790b6dd50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:58.895398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951cb1f-bc15-4ca3-b74b-54b790b6dd50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:02:58.896984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951cb1f-bc15-4ca3-b74b-54b790b6dd50 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:02:58.906690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 699/1416] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:02:59.800330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5111cc-de76-477a-b0e2-e8b1c63d7c1d None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:59.800908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5111cc-de76-477a-b0e2-e8b1c63d7c1d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:59.800908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5111cc-de76-477a-b0e2-e8b1c63d7c1d None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:59.802263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:02:59.807181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b55ea4-07d8-4e4b-b38d-bd5a93757503 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:02:59.807638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b55ea4-07d8-4e4b-b38d-bd5a93757503 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:02:59.807784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b55ea4-07d8-4e4b-b38d-bd5a93757503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:02:59.825762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-08b55ea4-07d8-4e4b-b38d-bd5a93757503 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:02:59.827014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-08b55ea4-07d8-4e4b-b38d-bd5a93757503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:02:59.834964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:02:59.988258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5111cc-de76-477a-b0e2-e8b1c63d7c1d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:00.002312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5111cc-de76-477a-b0e2-e8b1c63d7c1d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:00.007726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d90d4-dabd-4565-a18b-61d3427c1c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:00.008353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d90d4-dabd-4565-a18b-61d3427c1c8f service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:00.008631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d90d4-dabd-4565-a18b-61d3427c1c8f service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:00.008902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d90d4-dabd-4565-a18b-61d3427c1c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:00.016904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d90d4-dabd-4565-a18b-61d3427c1c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:00.018469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d90d4-dabd-4565-a18b-61d3427c1c8f service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:00.027705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 719/1419] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:00.922101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5588f-e723-4999-b9ad-b91eb369980e None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:00.922618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5588f-e723-4999-b9ad-b91eb369980e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:00.922618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5588f-e723-4999-b9ad-b91eb369980e None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:00.923992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:00.928930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b60b-d286-44ed-a113-d0993f3d51bc None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:00.929388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b60b-d286-44ed-a113-d0993f3d51bc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:00.929487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b60b-d286-44ed-a113-d0993f3d51bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:00.947100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-da35b60b-d286-44ed-a113-d0993f3d51bc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:00.948342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-da35b60b-d286-44ed-a113-d0993f3d51bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:00.956982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:01.116201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5588f-e723-4999-b9ad-b91eb369980e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:01.131884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5588f-e723-4999-b9ad-b91eb369980e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:01.137352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd9cc-2cea-411c-91bd-f60ce6b046c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:01.138290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd9cc-2cea-411c-91bd-f60ce6b046c9 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:01.138575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd9cc-2cea-411c-91bd-f60ce6b046c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:01.138936 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd9cc-2cea-411c-91bd-f60ce6b046c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:01.147375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd9cc-2cea-411c-91bd-f60ce6b046c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:01.149001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd9cc-2cea-411c-91bd-f60ce6b046c9 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:01.159312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 702/1422] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:02.035449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d120-c07d-43b5-a378-bf673a27a3f1 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:02.036034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d120-c07d-43b5-a378-bf673a27a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:02.036034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d120-c07d-43b5-a378-bf673a27a3f1 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:02.037412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:02.042253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4242-cea6-44c4-86df-85c6090c4359 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:02.042929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4242-cea6-44c4-86df-85c6090c4359 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:02.043076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4242-cea6-44c4-86df-85c6090c4359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:02.061261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-66cc4242-cea6-44c4-86df-85c6090c4359 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:02.062465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-66cc4242-cea6-44c4-86df-85c6090c4359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:02.070284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:02.220534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d120-c07d-43b5-a378-bf673a27a3f1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:02.234723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d120-c07d-43b5-a378-bf673a27a3f1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:02.240720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690e52f-ce99-4401-9aa8-b18ed6b723e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:02.241360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e52f-ce99-4401-9aa8-b18ed6b723e6 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:02.241645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e52f-ce99-4401-9aa8-b18ed6b723e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:02.241922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e52f-ce99-4401-9aa8-b18ed6b723e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:02.250711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690e52f-ce99-4401-9aa8-b18ed6b723e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:02.252329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690e52f-ce99-4401-9aa8-b18ed6b723e6 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:02.261685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 722/1425] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:03.110661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41778fe6-2d0a-4de1-b4ee-a4e02dfc9c8f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:03.111209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41778fe6-2d0a-4de1-b4ee-a4e02dfc9c8f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:03.111209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41778fe6-2d0a-4de1-b4ee-a4e02dfc9c8f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:03.112647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:03.117650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf4fa-0e89-4e17-ac86-f91a7dfca028 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:03.118052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf4fa-0e89-4e17-ac86-f91a7dfca028 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:03.118216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bf4fa-0e89-4e17-ac86-f91a7dfca028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:03.136524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-6d2bf4fa-0e89-4e17-ac86-f91a7dfca028 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:03.137716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6d2bf4fa-0e89-4e17-ac86-f91a7dfca028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:03.145983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:03.304771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41778fe6-2d0a-4de1-b4ee-a4e02dfc9c8f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:03.317730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41778fe6-2d0a-4de1-b4ee-a4e02dfc9c8f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:03.323338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4e5f2-04b5-4689-a170-b5addd31752d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:03.324020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e5f2-04b5-4689-a170-b5addd31752d service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:03.324306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e5f2-04b5-4689-a170-b5addd31752d service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:03.324589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4e5f2-04b5-4689-a170-b5addd31752d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:03.335532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4e5f2-04b5-4689-a170-b5addd31752d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:03.337146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4e5f2-04b5-4689-a170-b5addd31752d service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:03.346782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 705/1428] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:03:04.144112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ba0ea-c8fd-4dad-b1d0-94bb2fe523f1 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:04.144689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ba0ea-c8fd-4dad-b1d0-94bb2fe523f1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:04.144689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ba0ea-c8fd-4dad-b1d0-94bb2fe523f1 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:04.146038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:04.150891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9014-dd2f-46b0-8657-5adeafb2cdd0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:04.151321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9014-dd2f-46b0-8657-5adeafb2cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:04.151430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9014-dd2f-46b0-8657-5adeafb2cdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:04.169941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1caa9014-dd2f-46b0-8657-5adeafb2cdd0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:04.171131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1caa9014-dd2f-46b0-8657-5adeafb2cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:04.178948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:04.328587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ba0ea-c8fd-4dad-b1d0-94bb2fe523f1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:04.346965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ba0ea-c8fd-4dad-b1d0-94bb2fe523f1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:04.353203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b824a7f-0388-44ec-93b7-9936e80da9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:04.353844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824a7f-0388-44ec-93b7-9936e80da9e0 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:04.354131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824a7f-0388-44ec-93b7-9936e80da9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:04.354409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824a7f-0388-44ec-93b7-9936e80da9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:04.363451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b824a7f-0388-44ec-93b7-9936e80da9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:04.365106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b824a7f-0388-44ec-93b7-9936e80da9e0 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:04.375248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 725/1431] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:05.187699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf93cc-95eb-41f9-be35-4393be491ca3 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:05.188274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf93cc-95eb-41f9-be35-4393be491ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:05.188274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf93cc-95eb-41f9-be35-4393be491ca3 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:05.189658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:05.194685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c5a5-3cf4-4f5d-ae30-c13921881191 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:05.195115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c5a5-3cf4-4f5d-ae30-c13921881191 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:05.195235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c5a5-3cf4-4f5d-ae30-c13921881191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:05.212801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c945c5a5-3cf4-4f5d-ae30-c13921881191 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:05.213982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c945c5a5-3cf4-4f5d-ae30-c13921881191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:05.222253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:05.376551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf93cc-95eb-41f9-be35-4393be491ca3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:05.392970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf93cc-95eb-41f9-be35-4393be491ca3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:05.398348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3a43-de99-4533-8430-be2337546687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:05.398988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3a43-de99-4533-8430-be2337546687 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:05.399273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3a43-de99-4533-8430-be2337546687 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:05.399544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3a43-de99-4533-8430-be2337546687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:05.407828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3a43-de99-4533-8430-be2337546687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:05.409394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3a43-de99-4533-8430-be2337546687 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:05.418903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 708/1434] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:06.218791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c2c6-6f27-4dd2-bcc3-2f77383cfc03 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:06.219536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c2c6-6f27-4dd2-bcc3-2f77383cfc03 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:06.219536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c2c6-6f27-4dd2-bcc3-2f77383cfc03 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:06.220774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:06.225587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb7cc-c113-450d-a949-600721a2f85b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:06.226030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb7cc-c113-450d-a949-600721a2f85b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:06.226140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb7cc-c113-450d-a949-600721a2f85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:06.244490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a4bfb7cc-c113-450d-a949-600721a2f85b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:06.245703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a4bfb7cc-c113-450d-a949-600721a2f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:06.253548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:06.403820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87c2c6-6f27-4dd2-bcc3-2f77383cfc03 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:06.419843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87c2c6-6f27-4dd2-bcc3-2f77383cfc03 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:06.425700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c5443-f3c3-47b0-b128-bc8f83aa23fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:06.426344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c5443-f3c3-47b0-b128-bc8f83aa23fc service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:06.426633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c5443-f3c3-47b0-b128-bc8f83aa23fc service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:06.426915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c5443-f3c3-47b0-b128-bc8f83aa23fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:06.436028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c5443-f3c3-47b0-b128-bc8f83aa23fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:06.437619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c5443-f3c3-47b0-b128-bc8f83aa23fc service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:06.447151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 728/1437] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:07.245741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427aa9a-e4b7-43be-aa59-222a793bd973 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:07.246310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427aa9a-e4b7-43be-aa59-222a793bd973 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:07.246310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427aa9a-e4b7-43be-aa59-222a793bd973 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:07.247687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:07.252594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091a71-8a84-430b-9456-064fd46affa6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:07.253025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091a71-8a84-430b-9456-064fd46affa6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:07.253160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091a71-8a84-430b-9456-064fd46affa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:07.271149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ea091a71-8a84-430b-9456-064fd46affa6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:07.272314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ea091a71-8a84-430b-9456-064fd46affa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:07.281913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:07.432306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427aa9a-e4b7-43be-aa59-222a793bd973 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:07.446347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427aa9a-e4b7-43be-aa59-222a793bd973 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:07.451694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672fd7a-c7fe-45e3-8fc8-cf9c55fbf00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:07.452332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672fd7a-c7fe-45e3-8fc8-cf9c55fbf00a service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:07.452614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672fd7a-c7fe-45e3-8fc8-cf9c55fbf00a service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:07.452890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672fd7a-c7fe-45e3-8fc8-cf9c55fbf00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:07.460900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672fd7a-c7fe-45e3-8fc8-cf9c55fbf00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:07.462461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672fd7a-c7fe-45e3-8fc8-cf9c55fbf00a service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:07.472229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 711/1440] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:09.432593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7a54-b907-4a68-acb3-11ae1de31b27 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:09.433144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7a54-b907-4a68-acb3-11ae1de31b27 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:09.433144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7a54-b907-4a68-acb3-11ae1de31b27 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:09.434485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:09.439759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c520d-5cad-4acb-a7b7-c5a814b9c978 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:09.440205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c520d-5cad-4acb-a7b7-c5a814b9c978 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:09.440314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c520d-5cad-4acb-a7b7-c5a814b9c978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:09.457677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-422c520d-5cad-4acb-a7b7-c5a814b9c978 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:09.458871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-422c520d-5cad-4acb-a7b7-c5a814b9c978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:09.467192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:09.505472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7a54-b907-4a68-acb3-11ae1de31b27 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:09.516636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7a54-b907-4a68-acb3-11ae1de31b27 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:09.520110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45edc6-fd09-46b1-971f-345cb01303e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:09.520743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45edc6-fd09-46b1-971f-345cb01303e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:09.521028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45edc6-fd09-46b1-971f-345cb01303e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:09.521305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45edc6-fd09-46b1-971f-345cb01303e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:09.530130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45edc6-fd09-46b1-971f-345cb01303e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:09.531554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45edc6-fd09-46b1-971f-345cb01303e4 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:09.540853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 731/1443] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:11.751733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4a9e8-05cd-4b9d-9186-34e8d047fc50 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:11.752313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4a9e8-05cd-4b9d-9186-34e8d047fc50 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:11.752313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4a9e8-05cd-4b9d-9186-34e8d047fc50 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:11.753669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:11.758953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e53d5-627b-48b2-b402-63a5b55c2874 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:11.759403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e53d5-627b-48b2-b402-63a5b55c2874 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:11.759518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e53d5-627b-48b2-b402-63a5b55c2874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:11.778180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-8f5e53d5-627b-48b2-b402-63a5b55c2874 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:11.779366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8f5e53d5-627b-48b2-b402-63a5b55c2874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:11.787280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:03:11.826599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4a9e8-05cd-4b9d-9186-34e8d047fc50 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:11.837103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4a9e8-05cd-4b9d-9186-34e8d047fc50 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:11.840494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3025ed-0980-42e3-8eac-719676ed0b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:11.841126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3025ed-0980-42e3-8eac-719676ed0b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:11.841404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3025ed-0980-42e3-8eac-719676ed0b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:11.841676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3025ed-0980-42e3-8eac-719676ed0b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:11.850375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3025ed-0980-42e3-8eac-719676ed0b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:11.851811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3025ed-0980-42e3-8eac-719676ed0b7c service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:11.861029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 714/1446] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:14.213974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e1080-e0d8-4109-b60b-273009c3c99f None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:14.214533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e1080-e0d8-4109-b60b-273009c3c99f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:14.214533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e1080-e0d8-4109-b60b-273009c3c99f None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:14.215948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:14.221659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ece92-3708-4453-a23f-ecfbbd4eb215 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:14.222050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ece92-3708-4453-a23f-ecfbbd4eb215 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:14.222222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ece92-3708-4453-a23f-ecfbbd4eb215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:14.240606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c86ece92-3708-4453-a23f-ecfbbd4eb215 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:14.241816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c86ece92-3708-4453-a23f-ecfbbd4eb215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:14.249801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:14.288250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e1080-e0d8-4109-b60b-273009c3c99f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:14.300367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e1080-e0d8-4109-b60b-273009c3c99f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:14.303857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3425ee-679e-4783-8c03-6a8effd414bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:14.304497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3425ee-679e-4783-8c03-6a8effd414bb service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:14.304783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3425ee-679e-4783-8c03-6a8effd414bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:14.305067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3425ee-679e-4783-8c03-6a8effd414bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:14.314085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3425ee-679e-4783-8c03-6a8effd414bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:14.315511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3425ee-679e-4783-8c03-6a8effd414bb service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:14.324921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 734/1449] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:16.491164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72622cb7-2082-469d-a6bf-35abc5ff05b5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:16.491796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72622cb7-2082-469d-a6bf-35abc5ff05b5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:16.491796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72622cb7-2082-469d-a6bf-35abc5ff05b5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:16.493150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:16.499019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14c33-c1b9-4eec-b357-16b016c679ac None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:16.499444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14c33-c1b9-4eec-b357-16b016c679ac None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:16.499677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14c33-c1b9-4eec-b357-16b016c679ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:16.518003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1ae14c33-c1b9-4eec-b357-16b016c679ac None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:16.519196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1ae14c33-c1b9-4eec-b357-16b016c679ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:16.527022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:16.566151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72622cb7-2082-469d-a6bf-35abc5ff05b5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:16.577948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72622cb7-2082-469d-a6bf-35abc5ff05b5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:16.580872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4364b-32c6-4c89-8b8e-f748fd595442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:16.581514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4364b-32c6-4c89-8b8e-f748fd595442 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:16.581798 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4364b-32c6-4c89-8b8e-f748fd595442 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:16.582073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4364b-32c6-4c89-8b8e-f748fd595442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:16.591074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4364b-32c6-4c89-8b8e-f748fd595442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:16.593107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4364b-32c6-4c89-8b8e-f748fd595442 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:16.602533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 717/1452] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:18.695726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472347a-c687-44ec-a131-1beba3bec71b None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:18.696359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472347a-c687-44ec-a131-1beba3bec71b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:18.696359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472347a-c687-44ec-a131-1beba3bec71b None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:18.697663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:18.703327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7f3e-24b1-495d-ad69-28da88105d74 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:18.703778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7f3e-24b1-495d-ad69-28da88105d74 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:18.703890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7f3e-24b1-495d-ad69-28da88105d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:18.721878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d94f7f3e-24b1-495d-ad69-28da88105d74 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:18.723062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d94f7f3e-24b1-495d-ad69-28da88105d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:18.730763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:18.768450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472347a-c687-44ec-a131-1beba3bec71b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:18.779807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472347a-c687-44ec-a131-1beba3bec71b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:18.783243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326a14f-9ed5-4bb2-bc30-95a5b7578dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:18.783914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326a14f-9ed5-4bb2-bc30-95a5b7578dee service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:18.784191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326a14f-9ed5-4bb2-bc30-95a5b7578dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:18.784463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326a14f-9ed5-4bb2-bc30-95a5b7578dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:18.793603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326a14f-9ed5-4bb2-bc30-95a5b7578dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:18.795652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326a14f-9ed5-4bb2-bc30-95a5b7578dee service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:18.805012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 737/1455] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:20.869630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c927-7d17-44e1-954c-31387df5e2c4 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:20.870145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c927-7d17-44e1-954c-31387df5e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:20.870145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c927-7d17-44e1-954c-31387df5e2c4 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:20.871471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:20.877268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463847a3-eaeb-4512-993b-1430c03aa398 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:20.877708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463847a3-eaeb-4512-993b-1430c03aa398 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:20.877822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463847a3-eaeb-4512-993b-1430c03aa398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:20.895875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-463847a3-eaeb-4512-993b-1430c03aa398 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:20.897066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-463847a3-eaeb-4512-993b-1430c03aa398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:20.904870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:20.942724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48c927-7d17-44e1-954c-31387df5e2c4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:20.954137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48c927-7d17-44e1-954c-31387df5e2c4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:20.957686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d988fc-0889-4fb9-9ba1-d8a2273c49a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:20.958326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d988fc-0889-4fb9-9ba1-d8a2273c49a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:20.958610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d988fc-0889-4fb9-9ba1-d8a2273c49a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:20.958888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d988fc-0889-4fb9-9ba1-d8a2273c49a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:20.967722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d988fc-0889-4fb9-9ba1-d8a2273c49a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:20.969140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d988fc-0889-4fb9-9ba1-d8a2273c49a5 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:20.978530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 720/1458] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:23.056622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c241a-44ab-457b-bb4c-f4d4150f43ba None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:23.057084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c241a-44ab-457b-bb4c-f4d4150f43ba None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:23.057198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c241a-44ab-457b-bb4c-f4d4150f43ba None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:23.058575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:23.064401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb83b-9022-4f94-a94f-4b4b598d9884 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:23.064829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb83b-9022-4f94-a94f-4b4b598d9884 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:23.064985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb83b-9022-4f94-a94f-4b4b598d9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:23.083006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cdcdb83b-9022-4f94-a94f-4b4b598d9884 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:23.084246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cdcdb83b-9022-4f94-a94f-4b4b598d9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:23.092146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:23.134420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c241a-44ab-457b-bb4c-f4d4150f43ba None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:23.147169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c241a-44ab-457b-bb4c-f4d4150f43ba None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:23.152046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b592b-6e2c-456d-aa32-3133def2753f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:23.152689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b592b-6e2c-456d-aa32-3133def2753f service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:23.152981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b592b-6e2c-456d-aa32-3133def2753f service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:23.153316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b592b-6e2c-456d-aa32-3133def2753f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:23.163104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b592b-6e2c-456d-aa32-3133def2753f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:23.164589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b592b-6e2c-456d-aa32-3133def2753f service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:23.174800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 740/1461] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:03:25.303229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74141-3a25-492e-9219-f4bddeb6f524 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:25.303765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74141-3a25-492e-9219-f4bddeb6f524 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:25.303765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e74141-3a25-492e-9219-f4bddeb6f524 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:25.305157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 10:03:25.310812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325010c-87a0-4bbb-b0b8-114e3c64a574 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:25.311263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325010c-87a0-4bbb-b0b8-114e3c64a574 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:25.311381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325010c-87a0-4bbb-b0b8-114e3c64a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:25.317644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=79 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:03:25.330962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9325010c-87a0-4bbb-b0b8-114e3c64a574 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:25.332205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9325010c-87a0-4bbb-b0b8-114e3c64a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:25.340087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:25.377952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e74141-3a25-492e-9219-f4bddeb6f524 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:25.383351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=73 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:03:25.391009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e74141-3a25-492e-9219-f4bddeb6f524 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:25.394643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86bc9-322b-4618-b4b4-4df3d270e6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:25.395298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86bc9-322b-4618-b4b4-4df3d270e6fa service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:25.395609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86bc9-322b-4618-b4b4-4df3d270e6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:25.395884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86bc9-322b-4618-b4b4-4df3d270e6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:25.405925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86bc9-322b-4618-b4b4-4df3d270e6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:25.407361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86bc9-322b-4618-b4b4-4df3d270e6fa service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:25.417174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 723/1464] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:27.497791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8989181-8520-4128-ac91-6c1a9884461d None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:27.498353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8989181-8520-4128-ac91-6c1a9884461d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:27.498353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8989181-8520-4128-ac91-6c1a9884461d None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:27.499864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:27.505096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892850-e9be-4d9f-aa31-5c68c1aee782 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:27.505512 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892850-e9be-4d9f-aa31-5c68c1aee782 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:27.505659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892850-e9be-4d9f-aa31-5c68c1aee782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:27.523914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c2892850-e9be-4d9f-aa31-5c68c1aee782 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:27.525123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c2892850-e9be-4d9f-aa31-5c68c1aee782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:27.533087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:27.569422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8989181-8520-4128-ac91-6c1a9884461d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:27.580838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8989181-8520-4128-ac91-6c1a9884461d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:27.584371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bead9d-9cb6-4929-80d2-8a470e30f5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:27.585010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bead9d-9cb6-4929-80d2-8a470e30f5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:27.585296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bead9d-9cb6-4929-80d2-8a470e30f5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:27.585574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bead9d-9cb6-4929-80d2-8a470e30f5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:27.594803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bead9d-9cb6-4929-80d2-8a470e30f5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:27.596304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bead9d-9cb6-4929-80d2-8a470e30f5b9 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:27.605611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 743/1467] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:29.677138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3203eb8-e664-4323-95bf-fa087ec07dcd None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:29.677732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3203eb8-e664-4323-95bf-fa087ec07dcd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:29.677732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3203eb8-e664-4323-95bf-fa087ec07dcd None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:29.679094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:29.684902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff38c72-3775-43bc-a7b2-e0c5c8cb0980 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:29.685347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff38c72-3775-43bc-a7b2-e0c5c8cb0980 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:29.685445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff38c72-3775-43bc-a7b2-e0c5c8cb0980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:29.703605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-cff38c72-3775-43bc-a7b2-e0c5c8cb0980 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:29.704826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cff38c72-3775-43bc-a7b2-e0c5c8cb0980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:29.712859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:29.751167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3203eb8-e664-4323-95bf-fa087ec07dcd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:29.762029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3203eb8-e664-4323-95bf-fa087ec07dcd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:29.766220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfa34b-1eb3-4a75-9981-d8df67674dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:29.766854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfa34b-1eb3-4a75-9981-d8df67674dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:29.767137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfa34b-1eb3-4a75-9981-d8df67674dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:29.767410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfa34b-1eb3-4a75-9981-d8df67674dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:29.776355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfa34b-1eb3-4a75-9981-d8df67674dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:29.777766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfa34b-1eb3-4a75-9981-d8df67674dcc service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:29.787145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 726/1470] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:39.697793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=11 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:03:39.783005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=14 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:03:49.658020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c90b84-1a27-4076-8508-d0b68175c58a None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:49.658587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c90b84-1a27-4076-8508-d0b68175c58a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:49.658587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c90b84-1a27-4076-8508-d0b68175c58a None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:49.659972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 745/1471] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:49.666004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24f3f-b076-4a10-b6cf-359df6cc8c55 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:49.666719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24f3f-b076-4a10-b6cf-359df6cc8c55 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:49.666831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f24f3f-b076-4a10-b6cf-359df6cc8c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:49.687884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-50f24f3f-b076-4a10-b6cf-359df6cc8c55 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:49.689097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-50f24f3f-b076-4a10-b6cf-359df6cc8c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:49.696940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 727/1472] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:03:49.788344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9f40-04c9-47c9-a8d0-b56475c04eef None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:49.788633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9f40-04c9-47c9-a8d0-b56475c04eef None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:49.788913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9f40-04c9-47c9-a8d0-b56475c04eef None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:49.790298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 746/1473] 10.222.0.78 () {54 vars in 962 bytes} [Mon Jul 4 10:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:49.795646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a429-6396-4f37-b8ea-9574d5225ddf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:49.795984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a429-6396-4f37-b8ea-9574d5225ddf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:49.796301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13a429-6396-4f37-b8ea-9574d5225ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:49.814327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ed13a429-6396-4f37-b8ea-9574d5225ddf None None] MFA Rules not processed for user `34e1bd13b2094b93b41f10f209660b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:49.815516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ed13a429-6396-4f37-b8ea-9574d5225ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:49.822008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 728/1474] 10.222.0.78 () {58 vars in 1059 bytes} [Mon Jul 4 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:49.829943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e9f40-04c9-47c9-a8d0-b56475c04eef None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:49.842802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e9f40-04c9-47c9-a8d0-b56475c04eef None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:49.846365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44716-b548-4926-8957-6f4ede22570e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:49.847044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44716-b548-4926-8957-6f4ede22570e service glance] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:49.847369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44716-b548-4926-8957-6f4ede22570e service glance] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:49.847675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44716-b548-4926-8957-6f4ede22570e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:49.856844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44716-b548-4926-8957-6f4ede22570e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:49.858621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44716-b548-4926-8957-6f4ede22570e service glance] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:49.870207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 747/1475] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:52.004217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64db2-98c4-40f0-88a6-cb110883a908 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:52.004793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64db2-98c4-40f0-88a6-cb110883a908 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:52.004793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64db2-98c4-40f0-88a6-cb110883a908 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:52.006158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 729/1476] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:52.011757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136818b-775c-4f42-b4cb-f958e69695d9 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:52.012397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136818b-775c-4f42-b4cb-f958e69695d9 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:52.012397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136818b-775c-4f42-b4cb-f958e69695d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:52.030347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0136818b-775c-4f42-b4cb-f958e69695d9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:52.031551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0136818b-775c-4f42-b4cb-f958e69695d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:52.039760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 748/1477] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:52.062799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea64db2-98c4-40f0-88a6-cb110883a908 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:52.075865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea64db2-98c4-40f0-88a6-cb110883a908 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:52.080261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccafd4-7321-4d14-9784-5eecc1521fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:52.080910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccafd4-7321-4d14-9784-5eecc1521fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:52.081195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccafd4-7321-4d14-9784-5eecc1521fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:52.081474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccafd4-7321-4d14-9784-5eecc1521fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:52.082212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccafd4-7321-4d14-9784-5eecc1521fbf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:52.084036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-5eccafd4-7321-4d14-9784-5eecc1521fbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:03:52.084036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:03:52.084036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:03:52.085181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccafd4-7321-4d14-9784-5eecc1521fbf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:52.105717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 730/1478] 10.222.0.78 () {56 vars in 1108 bytes} [Mon Jul 4 10:03:52 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:03:54.176905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edfa0-bcbe-484e-9d9a-5ccb429255fe None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:54.177471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edfa0-bcbe-484e-9d9a-5ccb429255fe None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:54.177471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edfa0-bcbe-484e-9d9a-5ccb429255fe None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:54.178856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 749/1479] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:54.184019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99088-0c44-4f09-8e4e-3160ffb70a6d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:54.184441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99088-0c44-4f09-8e4e-3160ffb70a6d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:54.184596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99088-0c44-4f09-8e4e-3160ffb70a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:54.202891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-67e99088-0c44-4f09-8e4e-3160ffb70a6d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:54.204148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-67e99088-0c44-4f09-8e4e-3160ffb70a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:54.211963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 731/1480] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:54.255087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edfa0-bcbe-484e-9d9a-5ccb429255fe None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:54.270003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edfa0-bcbe-484e-9d9a-5ccb429255fe None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:54.275433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48825-a997-4269-8017-a3ffb117248e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:54.276175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48825-a997-4269-8017-a3ffb117248e service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:54.276525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48825-a997-4269-8017-a3ffb117248e service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:54.277307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48825-a997-4269-8017-a3ffb117248e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:54.285910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c48825-a997-4269-8017-a3ffb117248e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:54.287702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c48825-a997-4269-8017-a3ffb117248e service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:54.297595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 750/1481] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:56.506863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449da8a-6866-4c5c-932a-ad8fc8b3812f None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:56.507452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449da8a-6866-4c5c-932a-ad8fc8b3812f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:56.507452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449da8a-6866-4c5c-932a-ad8fc8b3812f None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:56.508828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 732/1482] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:56.514503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827f77-21a6-4b2c-8424-3a50bae791b7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:56.514948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827f77-21a6-4b2c-8424-3a50bae791b7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:56.515119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827f77-21a6-4b2c-8424-3a50bae791b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:56.536464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-fd827f77-21a6-4b2c-8424-3a50bae791b7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:56.537681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-fd827f77-21a6-4b2c-8424-3a50bae791b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:56.546723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 751/1483] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:03:56.583062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449da8a-6866-4c5c-932a-ad8fc8b3812f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:56.593751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449da8a-6866-4c5c-932a-ad8fc8b3812f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:56.597268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54356c-f8bf-4195-a6ff-0cbcf10adb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:56.597909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54356c-f8bf-4195-a6ff-0cbcf10adb9a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:56.598194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54356c-f8bf-4195-a6ff-0cbcf10adb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:56.598471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54356c-f8bf-4195-a6ff-0cbcf10adb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:56.607919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54356c-f8bf-4195-a6ff-0cbcf10adb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:56.609339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54356c-f8bf-4195-a6ff-0cbcf10adb9a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:56.618642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 733/1484] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:03:58.721484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b15d-f2d2-43e3-a3a2-baf40d30a279 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:58.722054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b15d-f2d2-43e3-a3a2-baf40d30a279 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:58.722054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b15d-f2d2-43e3-a3a2-baf40d30a279 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:58.723461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 752/1485] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:03:58.728659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d2069-bd0b-4c00-af45-e46281bbe77f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:58.729103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d2069-bd0b-4c00-af45-e46281bbe77f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:58.729217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d2069-bd0b-4c00-af45-e46281bbe77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:58.748131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c76d2069-bd0b-4c00-af45-e46281bbe77f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:03:58.749348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c76d2069-bd0b-4c00-af45-e46281bbe77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:03:58.757268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 734/1486] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:03:58.795189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b15d-f2d2-43e3-a3a2-baf40d30a279 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:03:58.806309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b15d-f2d2-43e3-a3a2-baf40d30a279 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:03:58.810466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d29c0a-f3d6-4d41-84a6-6b2aa388fc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:03:58.811100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29c0a-f3d6-4d41-84a6-6b2aa388fc46 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:03:58.811383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29c0a-f3d6-4d41-84a6-6b2aa388fc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:03:58.811691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29c0a-f3d6-4d41-84a6-6b2aa388fc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:03:58.820867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d29c0a-f3d6-4d41-84a6-6b2aa388fc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:03:58.822333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d29c0a-f3d6-4d41-84a6-6b2aa388fc46 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:03:58.831764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 753/1487] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:04:01.018151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0d38-54ec-4f83-9763-c95bc8e85e28 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:04:01.018722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0d38-54ec-4f83-9763-c95bc8e85e28 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:04:01.018722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0d38-54ec-4f83-9763-c95bc8e85e28 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:04:01.020158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 735/1488] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:04:01.025163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ac541-07a2-4823-b1f0-7e47935a7a39 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:04:01.025545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ac541-07a2-4823-b1f0-7e47935a7a39 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:04:01.025725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ac541-07a2-4823-b1f0-7e47935a7a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:04:01.043837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c47ac541-07a2-4823-b1f0-7e47935a7a39 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:04:01.045010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c47ac541-07a2-4823-b1f0-7e47935a7a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:04:01.052815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 754/1489] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:04:01.092311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0d38-54ec-4f83-9763-c95bc8e85e28 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:04:01.102984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0d38-54ec-4f83-9763-c95bc8e85e28 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:04:01.107106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c393cf8-b7c0-4b52-a88c-16978f8e2273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:04:01.107781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c393cf8-b7c0-4b52-a88c-16978f8e2273 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:04:01.108071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c393cf8-b7c0-4b52-a88c-16978f8e2273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:04:01.108352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c393cf8-b7c0-4b52-a88c-16978f8e2273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:04:01.117216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c393cf8-b7c0-4b52-a88c-16978f8e2273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:04:01.118648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c393cf8-b7c0-4b52-a88c-16978f8e2273 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:04:01.128953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 736/1490] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:04:03.331019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230b91-77d3-4a76-b0c2-fe9de95f4d75 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:04:03.331537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230b91-77d3-4a76-b0c2-fe9de95f4d75 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:04:03.331537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230b91-77d3-4a76-b0c2-fe9de95f4d75 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:04:03.332901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 755/1491] 10.222.0.78 () {54 vars in 926 bytes} [Mon Jul 4 10:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:04:03.339959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31f14-2a64-4b3a-8b61-2cdf8f0473c2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:04:03.340688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31f14-2a64-4b3a-8b61-2cdf8f0473c2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:04:03.340688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c31f14-2a64-4b3a-8b61-2cdf8f0473c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:04:03.360164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-06c31f14-2a64-4b3a-8b61-2cdf8f0473c2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:04:03.361371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-06c31f14-2a64-4b3a-8b61-2cdf8f0473c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:04:03.369179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 737/1492] 10.222.0.78 () {58 vars in 1023 bytes} [Mon Jul 4 10:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:04:03.409083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87230b91-77d3-4a76-b0c2-fe9de95f4d75 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:04:03.420895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87230b91-77d3-4a76-b0c2-fe9de95f4d75 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:04:03.424447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d461c4-c396-4391-863a-df9f3c2745b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:04:03.425085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d461c4-c396-4391-863a-df9f3c2745b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:04:03.425375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d461c4-c396-4391-863a-df9f3c2745b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:04:03.425653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d461c4-c396-4391-863a-df9f3c2745b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:04:03.435567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d461c4-c396-4391-863a-df9f3c2745b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:04:03.437047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d461c4-c396-4391-863a-df9f3c2745b7 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:04:03.447124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 756/1493] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:04:13.354591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=33 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:04:13.443179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=33 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:05:29.859792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5d4e-843f-4ff4-b7f5-5e0ae37474e7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:29.860362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5d4e-843f-4ff4-b7f5-5e0ae37474e7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:29.860362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b5d4e-843f-4ff4-b7f5-5e0ae37474e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:29.879292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9c2b5d4e-843f-4ff4-b7f5-5e0ae37474e7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:05:29.880615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9c2b5d4e-843f-4ff4-b7f5-5e0ae37474e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:05:29.888461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 738/1494] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:05:29.897088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83660def-f3d5-4a5c-a06a-597139c531cf None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:29.897621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83660def-f3d5-4a5c-a06a-597139c531cf None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:29.897727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83660def-f3d5-4a5c-a06a-597139c531cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:29.915847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-83660def-f3d5-4a5c-a06a-597139c531cf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:05:29.917019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-83660def-f3d5-4a5c-a06a-597139c531cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:05:29.924745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 757/1495] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:05:29.929455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b5d4e-843f-4ff4-b7f5-5e0ae37474e7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:29.939006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b5d4e-843f-4ff4-b7f5-5e0ae37474e7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:29.943636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:29.944694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:29.945217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:29.945681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:29.946567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:05:29.946879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:29.947920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:29.947920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:05:29.947920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:05:29.948808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:29.960880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 739/1496] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:05:29.968787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83660def-f3d5-4a5c-a06a-597139c531cf None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:29.978771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83660def-f3d5-4a5c-a06a-597139c531cf None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:29.983349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:29.984017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:29.984302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:29.984573 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:29.985262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:29.987008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING py.warnings [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:29.987008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: warnings.warn(msg) Jul 04 10:05:29.987008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: Jul 04 10:05:29.988309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.027609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 758/1497] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:05:29 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:05:30.029265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:30.039954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631544a-5561-4e26-86e3-36280c8a083a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:30.096907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:30.097612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.097903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.098185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.098898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:30.100471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:30.100471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:05:30.100471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:05:30.101674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.122572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 740/1498] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:05:30 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:05:30.126635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:30.137220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3521b57-12ef-44ef-a9b8-1eb7e387380a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:30.141797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:30.142460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.142747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.143029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.143792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:30.144817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING py.warnings [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:30.144817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: warnings.warn(msg) Jul 04 10:05:30.144817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: Jul 04 10:05:30.145714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.158399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 759/1499] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:05:30.163026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:30.173249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966546f5-f7f9-4cb7-b05a-b11e66a655b3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:30.178434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aff43-b4e3-42a4-9d14-144dbaf067ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:30.179091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aff43-b4e3-42a4-9d14-144dbaf067ca admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.179378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aff43-b4e3-42a4-9d14-144dbaf067ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.179688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aff43-b4e3-42a4-9d14-144dbaf067ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.180419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594aff43-b4e3-42a4-9d14-144dbaf067ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:30.181434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-594aff43-b4e3-42a4-9d14-144dbaf067ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:30.181434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:05:30.181434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:05:30.182308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594aff43-b4e3-42a4-9d14-144dbaf067ca admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.195675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 741/1500] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:05:30.199755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:30.209577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca548-49b7-4416-9840-e363554bf2ca admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:30.214260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6974c-aa4d-4c2b-a6e4-deecc356b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:30.215134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6974c-aa4d-4c2b-a6e4-deecc356b458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.215417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6974c-aa4d-4c2b-a6e4-deecc356b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.215725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6974c-aa4d-4c2b-a6e4-deecc356b458 admin admin] PATH_INFO: `/v3/projects/0fca8788b5f94ce8999e8508aa0a5b59/users/212f05a3e98b476e84d40859031a64a8/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.230577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6974c-aa4d-4c2b-a6e4-deecc356b458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fca8788b5f94ce8999e8508aa0a5b59, user_id=212f05a3e98b476e84d40859031a64a8, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:30.231629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING py.warnings [None req-74a6974c-aa4d-4c2b-a6e4-deecc356b458 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:30.231629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: warnings.warn(msg) Jul 04 10:05:30.231629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: Jul 04 10:05:30.233543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6974c-aa4d-4c2b-a6e4-deecc356b458 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.248101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 760/1501] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:05:30 2022] PUT /identity/v3/projects/0fca8788b5f94ce8999e8508aa0a5b59/users/212f05a3e98b476e84d40859031a64a8/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:05:30.260187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2b1c8-6bd3-4565-831c-d0a42adff480 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.260475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2b1c8-6bd3-4565-831c-d0a42adff480 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.260750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2b1c8-6bd3-4565-831c-d0a42adff480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.286266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-acd2b1c8-6bd3-4565-831c-d0a42adff480 None None] MFA Rules not processed for user `212f05a3e98b476e84d40859031a64a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:05:30.288013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-acd2b1c8-6bd3-4565-831c-d0a42adff480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:05:30.351391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 742/1502] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:05:30.370663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c31233-0690-4178-9a52-175261114ca9 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.370956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c31233-0690-4178-9a52-175261114ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.371238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c31233-0690-4178-9a52-175261114ca9 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.372915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 761/1503] 10.222.0.78 () {54 vars in 963 bytes} [Mon Jul 4 10:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:05:30.377628 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e41026-62d4-4dca-9029-f2c3b28ea182 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.377924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e41026-62d4-4dca-9029-f2c3b28ea182 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.378203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e41026-62d4-4dca-9029-f2c3b28ea182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.397165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a4e41026-62d4-4dca-9029-f2c3b28ea182 None None] MFA Rules not processed for user `4d8bee133d6a4583a31c87aa4d4af927`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:05:30.398347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a4e41026-62d4-4dca-9029-f2c3b28ea182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:05:30.442443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:05:30.451468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 743/1504] 10.222.0.78 () {58 vars in 1060 bytes} [Mon Jul 4 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:05:30.459329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c31233-0690-4178-9a52-175261114ca9 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:30.470431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c31233-0690-4178-9a52-175261114ca9 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:30.473924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:30.474558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.474837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.475110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.483191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:30.484648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.493825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 762/1505] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:05:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:05:30.534944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf7011-e2b1-484b-a104-b1b14b0cd6b1 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.535242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf7011-e2b1-484b-a104-b1b14b0cd6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.535512 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf7011-e2b1-484b-a104-b1b14b0cd6b1 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.536949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 744/1506] 10.222.0.78 () {52 vars in 829 bytes} [Mon Jul 4 10:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:05:30.540646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:30.604471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f8775-6780-4f1f-aac2-0a1be8d57e0a service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:30.609066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:30.609937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.610221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.610502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] PATH_INFO: `/v3/users/212f05a3e98b476e84d40859031a64a8` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.611716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=212f05a3e98b476e84d40859031a64a8)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:30.612747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING py.warnings [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:30.612747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: warnings.warn(msg) Jul 04 10:05:30.612747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: Jul 04 10:05:30.613950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.680499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212f05a3e98b476e84d40859031a64a8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:30.689872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212f05a3e98b476e84d40859031a64a8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:30.690588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212f05a3e98b476e84d40859031a64a8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:30.691227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212f05a3e98b476e84d40859031a64a8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:30.704143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212f05a3e98b476e84d40859031a64a8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:30.721013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:05:30.730738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 763/1507] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:05:30 2022] DELETE /identity/v3/users/212f05a3e98b476e84d40859031a64a8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:05:30.735084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.735370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.735677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.752992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:05:30.754182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:05:30.813126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 745/1508] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:05:30.823048 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:30.824555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:05:30.882061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03051-77cb-4d1f-a9dc-ed56e88b2b4b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:30.885617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eca9c-2228-4271-bbc7-6a014b32e3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:30.886261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eca9c-2228-4271-bbc7-6a014b32e3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:30.886542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eca9c-2228-4271-bbc7-6a014b32e3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:30.886817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eca9c-2228-4271-bbc7-6a014b32e3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:30.895622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eca9c-2228-4271-bbc7-6a014b32e3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:30.897663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eca9c-2228-4271-bbc7-6a014b32e3b8 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:30.906886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 764/1509] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:05:31.370070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:05:31.371559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:05:31.384368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a17e-cc21-498f-8a8b-73b6e0dbf288 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:05:31.389308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:05:31.390516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:05:31.390808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:05:31.391089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] PATH_INFO: `/v3/projects/0fca8788b5f94ce8999e8508aa0a5b59` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:05:31.392327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fca8788b5f94ce8999e8508aa0a5b59)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:05:31.393345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:05:31.393345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:05:31.393345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:05:31.394568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:05:31.465289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fca8788b5f94ce8999e8508aa0a5b59', 'request_id': 'req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:31.474793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fca8788b5f94ce8999e8508aa0a5b59', 'request_id': 'req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:31.480994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fca8788b5f94ce8999e8508aa0a5b59', 'request_id': 'req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:31.499667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] The token cache is being invalidate because project 0fca8788b5f94ce8999e8508aa0a5b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:05:31.499959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:31.500720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c9b87e62-d4b1-46df-b1c7-a530850dbe8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:05:31.502274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 746/1510] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:05:31 2022] DELETE /identity/v3/projects/0fca8788b5f94ce8999e8508aa0a5b59 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:05:40.902872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:05:41.496640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:07:16.464732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda1693-4434-4409-850e-c06a621fdea2 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:16.465354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda1693-4434-4409-850e-c06a621fdea2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:16.465354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda1693-4434-4409-850e-c06a621fdea2 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:16.466694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:16.471644 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca2102-1de4-4b2e-b180-af738ed8c39a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:16.472065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca2102-1de4-4b2e-b180-af738ed8c39a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:16.472221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca2102-1de4-4b2e-b180-af738ed8c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:16.491354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3aca2102-1de4-4b2e-b180-af738ed8c39a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:16.492594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3aca2102-1de4-4b2e-b180-af738ed8c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:16.670749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:16.824235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda1693-4434-4409-850e-c06a621fdea2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:16.826016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ceda1693-4434-4409-850e-c06a621fdea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:16.903172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda1693-4434-4409-850e-c06a621fdea2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:16.909263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649fc9a-5cae-477b-ad17-c8f32822e70c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:16.909914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649fc9a-5cae-477b-ad17-c8f32822e70c service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:16.910200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649fc9a-5cae-477b-ad17-c8f32822e70c service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:16.910483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649fc9a-5cae-477b-ad17-c8f32822e70c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:16.918980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649fc9a-5cae-477b-ad17-c8f32822e70c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:16.920612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649fc9a-5cae-477b-ad17-c8f32822e70c service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:16.930785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 766/1513] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:17.765809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ade2-9828-4e67-a758-cc7223f5cbab None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:17.766372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ade2-9828-4e67-a758-cc7223f5cbab None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:17.766372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ade2-9828-4e67-a758-cc7223f5cbab None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:17.767763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:17.772491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0850a2b-77bd-4666-b2ef-920e3e7259e1 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:17.772895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0850a2b-77bd-4666-b2ef-920e3e7259e1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:17.773053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0850a2b-77bd-4666-b2ef-920e3e7259e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:17.791833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b0850a2b-77bd-4666-b2ef-920e3e7259e1 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:17.793024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b0850a2b-77bd-4666-b2ef-920e3e7259e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:17.801676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:17.954617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446ade2-9828-4e67-a758-cc7223f5cbab None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:17.968862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446ade2-9828-4e67-a758-cc7223f5cbab None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:17.974720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fc7c-0f6b-4af6-be2c-2b07e4a32554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:17.975352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fc7c-0f6b-4af6-be2c-2b07e4a32554 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:17.975659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fc7c-0f6b-4af6-be2c-2b07e4a32554 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:17.975935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fc7c-0f6b-4af6-be2c-2b07e4a32554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:17.983926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545fc7c-0f6b-4af6-be2c-2b07e4a32554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:17.985560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545fc7c-0f6b-4af6-be2c-2b07e4a32554 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:17.994782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 749/1516] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:18.309253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68daba5-dc0d-4345-b4e6-a47b1a79dfaf None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:18.309459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68daba5-dc0d-4345-b4e6-a47b1a79dfaf None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:18.309730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68daba5-dc0d-4345-b4e6-a47b1a79dfaf None None] PATH_INFO: `/v3` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:18.311064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 768/1517] 10.222.0.60 () {54 vars in 925 bytes} [Mon Jul 4 10:07:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:07:18.317458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628bd34-d7ca-450b-8001-1142f1ecd7cc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:18.317782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628bd34-d7ca-450b-8001-1142f1ecd7cc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:18.318134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628bd34-d7ca-450b-8001-1142f1ecd7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:18.336606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2628bd34-d7ca-450b-8001-1142f1ecd7cc None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:18.337813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2628bd34-d7ca-450b-8001-1142f1ecd7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:18.399689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 750/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Jul 4 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:27.786512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=37 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:07:27.901162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab73f-da1f-4f1e-a80f-dda627a01f52 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:27.901360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab73f-da1f-4f1e-a80f-dda627a01f52 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:27.901635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab73f-da1f-4f1e-a80f-dda627a01f52 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:27.903029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 769/1519] 10.222.0.78 () {54 vars in 960 bytes} [Mon Jul 4 10:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:27.908430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac430a-aca7-4d6a-9f5a-f3eaf97f9c90 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:27.908912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac430a-aca7-4d6a-9f5a-f3eaf97f9c90 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:27.909021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac430a-aca7-4d6a-9f5a-f3eaf97f9c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:27.927204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c0ac430a-aca7-4d6a-9f5a-f3eaf97f9c90 None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:27.928437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0ac430a-aca7-4d6a-9f5a-f3eaf97f9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:27.936969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 751/1520] 10.222.0.78 () {58 vars in 1057 bytes} [Mon Jul 4 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:27.944490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab73f-da1f-4f1e-a80f-dda627a01f52 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:27.958410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab73f-da1f-4f1e-a80f-dda627a01f52 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:27.963341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d1f75-1061-471b-814b-dbf160f6a924 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:27.964015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d1f75-1061-471b-814b-dbf160f6a924 service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:27.964298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d1f75-1061-471b-814b-dbf160f6a924 service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:27.964578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d1f75-1061-471b-814b-dbf160f6a924 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:27.973512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d1f75-1061-471b-814b-dbf160f6a924 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:27.975106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d1f75-1061-471b-814b-dbf160f6a924 service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:27.984782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 770/1521] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:29.240748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd356b-87f5-419a-bc51-05eea78bd02b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:29.241304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd356b-87f5-419a-bc51-05eea78bd02b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:29.241435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd356b-87f5-419a-bc51-05eea78bd02b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:29.242762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:29.247484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851dfe8-b1e3-4a63-a547-da6dd896eb1f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:29.247913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851dfe8-b1e3-4a63-a547-da6dd896eb1f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:29.248079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851dfe8-b1e3-4a63-a547-da6dd896eb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:29.267834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a851dfe8-b1e3-4a63-a547-da6dd896eb1f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:29.269042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a851dfe8-b1e3-4a63-a547-da6dd896eb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:29.277941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:29.435844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd356b-87f5-419a-bc51-05eea78bd02b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:29.450238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd356b-87f5-419a-bc51-05eea78bd02b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:29.456236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301098f-fce0-4dae-baac-ac34016ccb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:29.456871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301098f-fce0-4dae-baac-ac34016ccb87 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:29.457152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301098f-fce0-4dae-baac-ac34016ccb87 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:29.457428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301098f-fce0-4dae-baac-ac34016ccb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:29.465617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301098f-fce0-4dae-baac-ac34016ccb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:29.467187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301098f-fce0-4dae-baac-ac34016ccb87 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:29.477248 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 753/1524] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:30.313114 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4722b-55e8-47f7-95ba-a9cc7da3be20 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:30.313711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4722b-55e8-47f7-95ba-a9cc7da3be20 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:30.313711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4722b-55e8-47f7-95ba-a9cc7da3be20 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:30.315073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 10:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:30.319859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1d3f4-c21c-42a9-8137-2c94e7cf3d5e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:30.320318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1d3f4-c21c-42a9-8137-2c94e7cf3d5e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:30.320447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1d3f4-c21c-42a9-8137-2c94e7cf3d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:30.338679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e6e1d3f4-c21c-42a9-8137-2c94e7cf3d5e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:30.339930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e6e1d3f4-c21c-42a9-8137-2c94e7cf3d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:30.348298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:30.498794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4722b-55e8-47f7-95ba-a9cc7da3be20 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:30.518367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4722b-55e8-47f7-95ba-a9cc7da3be20 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:30.523851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617bcd9-3d2e-484a-8bd8-67524e5c174d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:30.524492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bcd9-3d2e-484a-8bd8-67524e5c174d service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:30.524776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bcd9-3d2e-484a-8bd8-67524e5c174d service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:30.525051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617bcd9-3d2e-484a-8bd8-67524e5c174d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:30.533172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617bcd9-3d2e-484a-8bd8-67524e5c174d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:30.534766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617bcd9-3d2e-484a-8bd8-67524e5c174d service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:30.544369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 773/1527] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:34.511261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4214-62d0-4d7f-8033-c43846d5e146 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:34.511860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4214-62d0-4d7f-8033-c43846d5e146 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:34.511860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4214-62d0-4d7f-8033-c43846d5e146 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:34.513292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:34.518966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b2d2-f0db-401a-9c30-b35b81233fec None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:34.519388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b2d2-f0db-401a-9c30-b35b81233fec None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:34.519517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b2d2-f0db-401a-9c30-b35b81233fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:34.539785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-4178b2d2-f0db-401a-9c30-b35b81233fec None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:34.541013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-4178b2d2-f0db-401a-9c30-b35b81233fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:34.549773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:34.622321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4214-62d0-4d7f-8033-c43846d5e146 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:34.624722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8d9b4214-62d0-4d7f-8033-c43846d5e146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:34.682997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4214-62d0-4d7f-8033-c43846d5e146 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:34.687282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea98f-7df8-4435-aac5-0eaf2bfec2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:34.687990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea98f-7df8-4435-aac5-0eaf2bfec2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:34.688272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea98f-7df8-4435-aac5-0eaf2bfec2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:34.688542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea98f-7df8-4435-aac5-0eaf2bfec2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:34.697488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bea98f-7df8-4435-aac5-0eaf2bfec2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:34.698899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bea98f-7df8-4435-aac5-0eaf2bfec2b6 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:34.703746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:07:34.708655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 756/1530] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:36.750295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f5ae-5830-46da-b4eb-cfb96eb0ef75 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:36.750870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f5ae-5830-46da-b4eb-cfb96eb0ef75 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:36.750870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1f5ae-5830-46da-b4eb-cfb96eb0ef75 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:36.752332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:36.757510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bbb39-716f-4950-8c04-d763312d9ea7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:36.757958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bbb39-716f-4950-8c04-d763312d9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:36.758056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bbb39-716f-4950-8c04-d763312d9ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:36.775921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-879bbb39-716f-4950-8c04-d763312d9ea7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:36.777117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-879bbb39-716f-4950-8c04-d763312d9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:36.785805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:36.822654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1f5ae-5830-46da-b4eb-cfb96eb0ef75 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:36.834065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1f5ae-5830-46da-b4eb-cfb96eb0ef75 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:36.837590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac620d-b813-4533-9be0-327dc45f3a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:36.838258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac620d-b813-4533-9be0-327dc45f3a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:36.838546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac620d-b813-4533-9be0-327dc45f3a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:36.838829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac620d-b813-4533-9be0-327dc45f3a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:36.848363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac620d-b813-4533-9be0-327dc45f3a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:36.849799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac620d-b813-4533-9be0-327dc45f3a71 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:36.859152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 776/1533] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:40.474339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38220513-e36b-4d73-b870-b760b538e38c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:40.474919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38220513-e36b-4d73-b870-b760b538e38c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:40.474919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38220513-e36b-4d73-b870-b760b538e38c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:40.476287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:40.481723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af189d-2981-4718-bdac-e5ce68b76c09 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:40.482128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af189d-2981-4718-bdac-e5ce68b76c09 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:40.482323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af189d-2981-4718-bdac-e5ce68b76c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:40.500984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f4af189d-2981-4718-bdac-e5ce68b76c09 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:40.502182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f4af189d-2981-4718-bdac-e5ce68b76c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:40.510140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:40.821489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38220513-e36b-4d73-b870-b760b538e38c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:40.823147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-38220513-e36b-4d73-b870-b760b538e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:40.879673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38220513-e36b-4d73-b870-b760b538e38c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:40.883152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba735c-5f0d-4887-a6fe-2546ce1498a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:40.883815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba735c-5f0d-4887-a6fe-2546ce1498a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:40.884098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba735c-5f0d-4887-a6fe-2546ce1498a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:40.884371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba735c-5f0d-4887-a6fe-2546ce1498a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:40.893351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba735c-5f0d-4887-a6fe-2546ce1498a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:40.894763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba735c-5f0d-4887-a6fe-2546ce1498a9 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:40.904014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 759/1536] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:42.962639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea968c-d9e9-498d-b9d8-ab11c496c828 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:42.963236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea968c-d9e9-498d-b9d8-ab11c496c828 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:42.963236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea968c-d9e9-498d-b9d8-ab11c496c828 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:42.964672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 10:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:07:42.970484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a05f4-629b-4dee-8878-3f78f9d25bcc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:42.970935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a05f4-629b-4dee-8878-3f78f9d25bcc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:42.971045 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a05f4-629b-4dee-8878-3f78f9d25bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:42.993204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5f0a05f4-629b-4dee-8878-3f78f9d25bcc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:07:42.994419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5f0a05f4-629b-4dee-8878-3f78f9d25bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:43.003528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:07:43.301921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea968c-d9e9-498d-b9d8-ab11c496c828 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:07:43.303649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d9ea968c-d9e9-498d-b9d8-ab11c496c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:07:43.317092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea968c-d9e9-498d-b9d8-ab11c496c828 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:07:43.320608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69e010-f9c2-4866-b5c8-343eeb76594d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:07:43.321241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e010-f9c2-4866-b5c8-343eeb76594d service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:07:43.321526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e010-f9c2-4866-b5c8-343eeb76594d service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:07:43.321801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69e010-f9c2-4866-b5c8-343eeb76594d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:07:43.331247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69e010-f9c2-4866-b5c8-343eeb76594d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:07:43.332781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69e010-f9c2-4866-b5c8-343eeb76594d service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:07:43.342171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 779/1539] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:07:52.984857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=32 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:07:53.338090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=33 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:22.074227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf44ef-cbab-41ac-813f-fdb1ca9e2144 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.074879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf44ef-cbab-41ac-813f-fdb1ca9e2144 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.074879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf44ef-cbab-41ac-813f-fdb1ca9e2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.098111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cfbf44ef-cbab-41ac-813f-fdb1ca9e2144 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.099332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cfbf44ef-cbab-41ac-813f-fdb1ca9e2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.111309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 761/1540] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:22.120054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25211ce2-d8a2-4f23-968b-1046c5c4daea None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.121122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25211ce2-d8a2-4f23-968b-1046c5c4daea None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.121642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25211ce2-d8a2-4f23-968b-1046c5c4daea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.144262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-25211ce2-d8a2-4f23-968b-1046c5c4daea None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.145889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-25211ce2-d8a2-4f23-968b-1046c5c4daea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.159221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 780/1541] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:22.164418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf44ef-cbab-41ac-813f-fdb1ca9e2144 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.181161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf44ef-cbab-41ac-813f-fdb1ca9e2144 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.190953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.191663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.191950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.192227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.193186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:22.193496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.195098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.212709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 762/1542] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:22.222523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25211ce2-d8a2-4f23-968b-1046c5c4daea None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.233591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25211ce2-d8a2-4f23-968b-1046c5c4daea None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.243660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.244621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.245132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.245646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.246594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.248912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.291127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 781/1543] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:22.296382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.314283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c328c7e-e9fb-42d2-8373-3210d55225c3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.400210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95541dcd-94b6-44fd-9140-2814954d92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.400818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95541dcd-94b6-44fd-9140-2814954d92b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.401099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95541dcd-94b6-44fd-9140-2814954d92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.401377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95541dcd-94b6-44fd-9140-2814954d92b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.402080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95541dcd-94b6-44fd-9140-2814954d92b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.405051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95541dcd-94b6-44fd-9140-2814954d92b4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.445125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 763/1544] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:22.449212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.467632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dbfa1-2f6b-424c-adcd-e420398ac334 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.476146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658b6ff-b04f-4fae-a0e5-c8f723d830c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.477230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658b6ff-b04f-4fae-a0e5-c8f723d830c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.477729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658b6ff-b04f-4fae-a0e5-c8f723d830c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.478373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658b6ff-b04f-4fae-a0e5-c8f723d830c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.479360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658b6ff-b04f-4fae-a0e5-c8f723d830c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.481430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658b6ff-b04f-4fae-a0e5-c8f723d830c7 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.499244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e7d5-3603-4321-b164-e4bf4d4120e7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.499591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e7d5-3603-4321-b164-e4bf4d4120e7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.499842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e7d5-3603-4321-b164-e4bf4d4120e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.501717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 782/1545] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:22.506283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61ce32-b3a4-4bb7-92aa-7e639a0a22fe None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.506897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61ce32-b3a4-4bb7-92aa-7e639a0a22fe None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.507407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61ce32-b3a4-4bb7-92aa-7e639a0a22fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.532907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ebd8e7d5-3603-4321-b164-e4bf4d4120e7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.534133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ebd8e7d5-3603-4321-b164-e4bf4d4120e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.535640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9f61ce32-b3a4-4bb7-92aa-7e639a0a22fe None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.537094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9f61ce32-b3a4-4bb7-92aa-7e639a0a22fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.549997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 764/1546] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:22.551044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8e7d5-3603-4321-b164-e4bf4d4120e7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.553161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 783/1547] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:09:22.563688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39ae3-b4f8-438d-8074-e80f97c00b5c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.564400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39ae3-b4f8-438d-8074-e80f97c00b5c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.564903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39ae3-b4f8-438d-8074-e80f97c00b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.575308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8e7d5-3603-4321-b164-e4bf4d4120e7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.603390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3cd39ae3-b4f8-438d-8074-e80f97c00b5c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.605104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.605424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3cd39ae3-b4f8-438d-8074-e80f97c00b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.605802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.606326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.606614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.607392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.609775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.625205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 784/1548] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:22.626938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60546d-ef29-44b2-9298-6db4fb38390d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.627594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60546d-ef29-44b2-9298-6db4fb38390d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.628114 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60546d-ef29-44b2-9298-6db4fb38390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.629014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 765/1549] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:22.632777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.649816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca5f54-72bd-4f7f-bffb-eac4da9a5548 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.652852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ad60546d-ef29-44b2-9298-6db4fb38390d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.654981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ad60546d-ef29-44b2-9298-6db4fb38390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.661575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.662256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.662536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.662813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.663544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:22.665498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.667234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.673324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 785/1550] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:22.674443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60546d-ef29-44b2-9298-6db4fb38390d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.687073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60546d-ef29-44b2-9298-6db4fb38390d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.691623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 766/1551] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:22.691623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.699918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.701698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.702236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.702852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] PATH_INFO: `/v3/projects/b325c904880846668c079d009e709085/users/ab81044ba8c54e8d808c4aed5a659929/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.710648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9629-5e63-4ad5-a22f-3f49ddd311cb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.727599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2396715-99e4-4b7c-b851-643a04b5e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.727599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2396715-99e4-4b7c-b851-643a04b5e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.727599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2396715-99e4-4b7c-b851-643a04b5e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.727599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2396715-99e4-4b7c-b851-643a04b5e0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.728049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2396715-99e4-4b7c-b851-643a04b5e0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:22.728049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2396715-99e4-4b7c-b851-643a04b5e0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.728985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2396715-99e4-4b7c-b851-643a04b5e0f3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.730380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b325c904880846668c079d009e709085, user_id=ab81044ba8c54e8d808c4aed5a659929, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.733600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.750430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 767/1552] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:22.754559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6a406-6a6b-475e-8a36-ae9ffd5b26c3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.754858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6a406-6a6b-475e-8a36-ae9ffd5b26c3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.755136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6a406-6a6b-475e-8a36-ae9ffd5b26c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.759293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 786/1553] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:22 2022] PUT /identity/v3/projects/b325c904880846668c079d009e709085/users/ab81044ba8c54e8d808c4aed5a659929/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:22.760402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.788971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-29e6a406-6a6b-475e-8a36-ae9ffd5b26c3 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.790184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-29e6a406-6a6b-475e-8a36-ae9ffd5b26c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.865213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c2006-f222-40f5-b682-64151d77735b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.877230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fd2aa-5fc1-4762-afa4-eca32d4caaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.878291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fd2aa-5fc1-4762-afa4-eca32d4caaff admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.878788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fd2aa-5fc1-4762-afa4-eca32d4caaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.879299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fd2aa-5fc1-4762-afa4-eca32d4caaff admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.880265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fd2aa-5fc1-4762-afa4-eca32d4caaff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.882662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fd2aa-5fc1-4762-afa4-eca32d4caaff admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:22.916955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 768/1554] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:22.918117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6a406-6a6b-475e-8a36-ae9ffd5b26c3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:22.924834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 787/1555] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:22.926338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4ffe-b609-4507-bb9a-fbecfda235bb None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.926634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4ffe-b609-4507-bb9a-fbecfda235bb None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.926915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4ffe-b609-4507-bb9a-fbecfda235bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.927874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6a406-6a6b-475e-8a36-ae9ffd5b26c3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:22.944728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-bfdf4ffe-b609-4507-bb9a-fbecfda235bb None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:22.945935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-bfdf4ffe-b609-4507-bb9a-fbecfda235bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:22.954451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:22.986419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd21fd2-8a2c-46ca-9020-4cd9d7493ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:22.987092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21fd2-8a2c-46ca-9020-4cd9d7493ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:22.987381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21fd2-8a2c-46ca-9020-4cd9d7493ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:22.987694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21fd2-8a2c-46ca-9020-4cd9d7493ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:22.988394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd21fd2-8a2c-46ca-9020-4cd9d7493ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:22.989418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-ebd21fd2-8a2c-46ca-9020-4cd9d7493ae1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:09:22.989418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:09:22.989418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:09:22.990630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd21fd2-8a2c-46ca-9020-4cd9d7493ae1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.006762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 788/1556] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.008089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01011-d3aa-4354-8274-193129951e94 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.008528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01011-d3aa-4354-8274-193129951e94 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.008653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01011-d3aa-4354-8274-193129951e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.016798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:23.021701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 769/1557] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:22 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.021701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2cc5f-294f-4202-b379-035e62eaea0b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.021701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2cc5f-294f-4202-b379-035e62eaea0b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.021701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2cc5f-294f-4202-b379-035e62eaea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.030719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d4d01011-d3aa-4354-8274-193129951e94 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.031956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d4d01011-d3aa-4354-8274-193129951e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.040778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c1b2cc5f-294f-4202-b379-035e62eaea0b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.041978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c1b2cc5f-294f-4202-b379-035e62eaea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.091625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 789/1558] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.092824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf707-bbda-42bd-a047-094c00c1aff7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.093146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf707-bbda-42bd-a047-094c00c1aff7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.093426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf707-bbda-42bd-a047-094c00c1aff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.110825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 770/1559] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.111362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9fbbf707-bbda-42bd-a047-094c00c1aff7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.111965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c85c-3c59-4543-b8ff-955f208b4d7d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.112197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9fbbf707-bbda-42bd-a047-094c00c1aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.112306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c85c-3c59-4543-b8ff-955f208b4d7d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.112528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c85c-3c59-4543-b8ff-955f208b4d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.120416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 790/1560] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.121697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798bbd4-18aa-4c3a-a5c1-76fcac78b9fe None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.122057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798bbd4-18aa-4c3a-a5c1-76fcac78b9fe None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.122343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798bbd4-18aa-4c3a-a5c1-76fcac78b9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.134247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9281c85c-3c59-4543-b8ff-955f208b4d7d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.135469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9281c85c-3c59-4543-b8ff-955f208b4d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.140880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9798bbd4-18aa-4c3a-a5c1-76fcac78b9fe None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.142467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9798bbd4-18aa-4c3a-a5c1-76fcac78b9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.144483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 771/1561] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.148563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281c85c-3c59-4543-b8ff-955f208b4d7d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.152842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 791/1562] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.153538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798bbd4-18aa-4c3a-a5c1-76fcac78b9fe None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.159119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281c85c-3c59-4543-b8ff-955f208b4d7d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.164410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.164789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.165078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.165359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.166055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.168339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.191972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 772/1563] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.192994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.202846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd1631-89e6-45ff-94f0-7cdac08544ce admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.207508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b379c0-4aaf-4c80-ae9d-103e4213f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.208195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b379c0-4aaf-4c80-ae9d-103e4213f125 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.208487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b379c0-4aaf-4c80-ae9d-103e4213f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.208767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b379c0-4aaf-4c80-ae9d-103e4213f125 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.209453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b379c0-4aaf-4c80-ae9d-103e4213f125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.211401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b379c0-4aaf-4c80-ae9d-103e4213f125 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.215212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798bbd4-18aa-4c3a-a5c1-76fcac78b9fe None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.218858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940cc34-527f-4e24-b632-5f7668d561d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.219494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940cc34-527f-4e24-b632-5f7668d561d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.219804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940cc34-527f-4e24-b632-5f7668d561d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.220081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940cc34-527f-4e24-b632-5f7668d561d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.231918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 773/1564] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/users => generated 302 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.232950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940cc34-527f-4e24-b632-5f7668d561d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.233794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b14477-77a9-4fe9-bfcb-58712904474e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.234098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b14477-77a9-4fe9-bfcb-58712904474e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.234381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b14477-77a9-4fe9-bfcb-58712904474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.234643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940cc34-527f-4e24-b632-5f7668d561d0 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.245052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 792/1565] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:23.246376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4249fa-f968-42ad-adc2-2a575064b61f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.246730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4249fa-f968-42ad-adc2-2a575064b61f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.246996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4249fa-f968-42ad-adc2-2a575064b61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.253712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-59b14477-77a9-4fe9-bfcb-58712904474e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.254927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-59b14477-77a9-4fe9-bfcb-58712904474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.264195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 774/1566] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.266148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5d4249fa-f968-42ad-adc2-2a575064b61f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.267360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5d4249fa-f968-42ad-adc2-2a575064b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.268773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546302-bf01-4111-9b3c-79a9e3e0f62c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.269173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546302-bf01-4111-9b3c-79a9e3e0f62c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.269500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546302-bf01-4111-9b3c-79a9e3e0f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.280846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 793/1567] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.280846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0e2fa-cfc2-4e10-badb-5ab395c02f36 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.280846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0e2fa-cfc2-4e10-badb-5ab395c02f36 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.281152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0e2fa-cfc2-4e10-badb-5ab395c02f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.289617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ff546302-bf01-4111-9b3c-79a9e3e0f62c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.290886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ff546302-bf01-4111-9b3c-79a9e3e0f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.303331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 775/1568] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.303331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546302-bf01-4111-9b3c-79a9e3e0f62c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.303929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-cfe0e2fa-cfc2-4e10-badb-5ab395c02f36 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:23.305228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cfe0e2fa-cfc2-4e10-badb-5ab395c02f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:23.311531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546302-bf01-4111-9b3c-79a9e3e0f62c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.319929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.320131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 794/1569] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:23.320229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.320316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0e2fa-cfc2-4e10-badb-5ab395c02f36 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.320400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.320400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.320400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:23.320400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.320400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.329451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0e2fa-cfc2-4e10-badb-5ab395c02f36 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.335208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.335631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 776/1570] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:23.335936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.336270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.336576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.337366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.337835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.339286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.352260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e5ba-f8e8-4f4b-b119-0875c09aa26d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.356921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 795/1571] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:23.356921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.362470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.363331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.363720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.364073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.364932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.365307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410749-6628-47e8-ad01-62d1f92346b3 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.366972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.370488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.371204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.371854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.372133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.374053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:23.374371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.375776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING py.warnings [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:09:23.375776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: warnings.warn(msg) Jul 04 10:09:23.375776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: Jul 04 10:09:23.376651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.380906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 777/1572] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:23.381724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.392896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 796/1573] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:23.393297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef23eb5-d807-4d99-9f5a-bf88284fd333 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.393755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.398145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.398937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.399303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.399771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.400420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:23.400733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.404467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.405520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f4e1c-368f-4dc2-8750-4474424489e5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.411753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.412803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.413093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.413539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.414288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:23.414650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.416318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.425748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 778/1574] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:23.425748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.437683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 797/1575] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:23.437683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.445451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d700166-cfc2-4d8c-aec8-b470d769d0e0 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.452250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfae30-63f1-4095-8cd3-b58cdf8b2efc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.453953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.454697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.455042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.455326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.456107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.458062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.458278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.458743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.459038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.459309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.460554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:23.460876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.462703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.478874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 779/1576] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:23.479895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.492348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda32f3-0118-451d-baf2-9da6103e8c03 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.496741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 798/1577] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/projects => generated 391 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.500822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.501405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.502104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.502396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.502720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.503612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.505287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.506999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:23.522703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 780/1578] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:23.523621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.526315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:23.537570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c5000-8fd8-4f78-b699-9385dc6548f1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.582610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2f5cb-33c6-42bf-aec0-9ced16498e05 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.587996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.588757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.589110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.589483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.590301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.592603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.603491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 799/1579] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:23.604608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.620694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.622190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.622618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.623099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.624126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.624617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41b9ce-f156-4fbc-90b3-12c0f6be1b65 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.626273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.631002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.632064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.632710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.633145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.634002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.636572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.668600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 781/1580] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.671470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.687012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 800/1581] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.687012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.762109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985bfe-8eeb-4717-87df-a22d596b71e1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.769086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.769767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.770057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.770339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.771058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.773165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.773407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a609c-a22d-4baa-b5ab-7e62e97f3e64 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.780357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.781315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.781795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.782390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.783592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.785916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.807299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 782/1582] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.807964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.819546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 801/1583] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:23.821075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.880914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a427-9e95-480c-bbc3-65924ec9cb8d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.894632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:23.910906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb554e49-1d2b-46d3-a00e-0d0b9eadcf6d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:23.919014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.919986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.920295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.920555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] PATH_INFO: `/v3/projects/8129fa5a8d9245bbb64e936e0820281a/users/f2174057821d49eabe2b7ffea258cf1c/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.940253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8129fa5a8d9245bbb64e936e0820281a, user_id=f2174057821d49eabe2b7ffea258cf1c, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.943760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:23.966156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 802/1584] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:23 2022] PUT /identity/v3/projects/8129fa5a8d9245bbb64e936e0820281a/users/f2174057821d49eabe2b7ffea258cf1c/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:23.966774 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:23.980483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:23.981270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:23.981627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:23.981981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:23.982271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:23.983216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:23.984967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.010293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 783/1585] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:23 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:24.011048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.025101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5282d-70fd-4eba-878f-c6f3888bb3b7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.066900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bddc5a-6fff-4530-8f52-a9952e6c05cd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.071947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.072848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.073126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.073539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] PATH_INFO: `/v3/projects/566ac6158a1844aab5a14fab8f5a5e33/users/18437c56cc874e44bda0c2974718856c/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.091308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566ac6158a1844aab5a14fab8f5a5e33, user_id=18437c56cc874e44bda0c2974718856c, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.094872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.106384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.107499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.108129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.108632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.109547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.112067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.113131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 803/1586] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:23 2022] PUT /identity/v3/projects/566ac6158a1844aab5a14fab8f5a5e33/users/18437c56cc874e44bda0c2974718856c/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:24.114057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.148046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 784/1587] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:24.149753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.170282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d8b4-7525-481a-a196-1b0bc30c5e3e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.189532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49326310-af1f-4633-9dda-996f8bb01c61 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.194875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.195764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.196049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.196322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.197015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.198193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING py.warnings [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:09:24.198193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: warnings.warn(msg) Jul 04 10:09:24.198193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: Jul 04 10:09:24.199480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.229392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 804/1588] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:24.229392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.242674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467ba4-087a-4fe2-9ef9-740cc698856c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.249576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f6e62-0027-40d5-8dcb-5eb4973c92bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.250511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6e62-0027-40d5-8dcb-5eb4973c92bf admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.250809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6e62-0027-40d5-8dcb-5eb4973c92bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.251378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6e62-0027-40d5-8dcb-5eb4973c92bf admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.252254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f6e62-0027-40d5-8dcb-5eb4973c92bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.254452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f6e62-0027-40d5-8dcb-5eb4973c92bf admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.257971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.258882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.259357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.259820 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.260818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.263073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.283071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 805/1589] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:24.288578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1674-2476-4bbe-beb8-156c5891fcf8 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.288955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1674-2476-4bbe-beb8-156c5891fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.289313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1674-2476-4bbe-beb8-156c5891fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.293444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 785/1590] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:24.294424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.306692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9317-0257-4543-8b9e-62f73467ef0a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.315610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d59a9d-854b-4645-82c4-c3d5fac3c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.316750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d59a9d-854b-4645-82c4-c3d5fac3c1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.317131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d59a9d-854b-4645-82c4-c3d5fac3c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.317478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d59a9d-854b-4645-82c4-c3d5fac3c1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.318294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d59a9d-854b-4645-82c4-c3d5fac3c1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.320559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d59a9d-854b-4645-82c4-c3d5fac3c1c5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.323636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-231a1674-2476-4bbe-beb8-156c5891fcf8 None None] MFA Rules not processed for user `f2174057821d49eabe2b7ffea258cf1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:24.325442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-231a1674-2476-4bbe-beb8-156c5891fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:24.333357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 786/1591] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.335211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ca52-b9c8-491c-b82e-63a04d8c4dd0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.336567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ca52-b9c8-491c-b82e-63a04d8c4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.336567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ca52-b9c8-491c-b82e-63a04d8c4dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.357196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5c40ca52-b9c8-491c-b82e-63a04d8c4dd0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:24.358726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5c40ca52-b9c8-491c-b82e-63a04d8c4dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:24.373565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 787/1592] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:24.373565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40ca52-b9c8-491c-b82e-63a04d8c4dd0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.380650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:24.385128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40ca52-b9c8-491c-b82e-63a04d8c4dd0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.394372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:24.394943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.395661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.396234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.396234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.397729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.399567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.419823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 788/1593] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.421082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.432431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 806/1594] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:24.432431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1674-2476-4bbe-beb8-156c5891fcf8 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.440580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802323b-1d37-401b-b223-a730d8590069 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.442727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1674-2476-4bbe-beb8-156c5891fcf8 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.446312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.447083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.447357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.447666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.448488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.449621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.450329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.450989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.452590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.453471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.454706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.456688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.462759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 789/1595] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.467548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.472061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 807/1596] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.473277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.481453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbb986-7abb-4db4-95b3-854495c55e91 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.486965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.487480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71af0-71d7-41be-8d80-c4c43c33e67f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.487736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.488026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.488305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.489219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.490973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.494953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.496371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.497271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.497765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.498772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.501354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.502981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 790/1597] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.504612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.516160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 808/1598] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.517705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.531110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1a815-96c1-46f0-abc5-33f8324f0156 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.537806 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.538896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.539382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.539872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.541287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.543659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.563188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 809/1599] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.563802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.579947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eae56f-b97d-4133-b437-9cd99a9b4e48 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.585082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.585845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.586311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.586663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.587448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.589913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.605133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e361b-e0d1-423f-a81f-bc65d590ffc3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.611459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.612344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.612689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.612930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.624507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.626140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.626607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 810/1600] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:24.627552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.642473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 791/1601] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:24.643517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.655050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2bec7-28d5-4620-932e-f87c58cf9d21 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.704514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08d09f-aa4d-4a77-8032-252bf09904dd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.714402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.715188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.715680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.715868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.717381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.719370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.735645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 811/1602] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.736559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.751989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df0255-8b5c-4937-83f9-4e235fd9233d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.769088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.769276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.769803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.770095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.770375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.771123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.771855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.772386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.773544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.774652 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.776533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.778489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.792295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 792/1603] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.793330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.795759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 812/1604] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:24.798812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.814007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb2aa9-4882-4bc2-a959-643172a3fba5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.817888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b768444-0371-48d7-bc3e-8360d151d7c0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.823451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.823725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.824772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.824905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.825087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.825203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.825492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] PATH_INFO: `/v3/projects/6a1d939cb2794275abc996ba95c93811/users/c35675c94f9a44c7943501d33abb0f3c/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.825648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] PATH_INFO: `/v3/projects/ed9172304b2140c780cf8a55506b17cd/users/036e571e1c2f486f80a21a61b2c742cf/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.846694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9172304b2140c780cf8a55506b17cd, user_id=036e571e1c2f486f80a21a61b2c742cf, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.850006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.861519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1d939cb2794275abc996ba95c93811, user_id=c35675c94f9a44c7943501d33abb0f3c, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:24.862256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:09:24.862256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:09:24.862256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:09:24.865202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:24.872878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 813/1605] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:24 2022] PUT /identity/v3/projects/ed9172304b2140c780cf8a55506b17cd/users/036e571e1c2f486f80a21a61b2c742cf/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:24.873607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.894007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 793/1606] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:24 2022] PUT /identity/v3/projects/6a1d939cb2794275abc996ba95c93811/users/c35675c94f9a44c7943501d33abb0f3c/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:24.896608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:24.958515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:24.971097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:24.979049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623e27-396e-4d75-90e5-8398b1a2be5b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.984997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.985936 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.986185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.986577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] PATH_INFO: `/v3/projects/1d63a78240934c4787d7ee23555a488e/users/269294e798284b368d4b7dabfcd58b44/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.986763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c8557-04cb-4a38-8d93-966c180a31a3 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:24.995235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:24.995958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:24.996695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:24.996982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:24.997698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.000199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.004830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d63a78240934c4787d7ee23555a488e, user_id=269294e798284b368d4b7dabfcd58b44, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.007481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.024466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 794/1607] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:24 2022] PUT /identity/v3/projects/1d63a78240934c4787d7ee23555a488e/users/269294e798284b368d4b7dabfcd58b44/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:25.025453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.038519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 814/1608] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:24 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:25.038519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.050578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7dfe-cdc1-4bc6-b80c-91ef469f4e13 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:25.124201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f1d1c-0b41-4889-ac88-aca02f372636 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:25.129999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca75eb-8914-4bf0-b1de-b8fb41905bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:25.131260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca75eb-8914-4bf0-b1de-b8fb41905bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.131260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca75eb-8914-4bf0-b1de-b8fb41905bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.131447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca75eb-8914-4bf0-b1de-b8fb41905bdb admin admin] PATH_INFO: `/v3/projects/71c833c25fd945f1ad729d66bde51100/users/4fc58f7ca26240ef9c1e458dd5832a15/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.198800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36921-4dbe-44c2-b2d9-67b0fed7e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:25.198800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36921-4dbe-44c2-b2d9-67b0fed7e3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.198800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36921-4dbe-44c2-b2d9-67b0fed7e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.198800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36921-4dbe-44c2-b2d9-67b0fed7e3c1 admin admin] PATH_INFO: `/v3/projects/05196cf3447a4e17ac06976291ac4c92/users/0c3d791666e742e4915d4f52d8dbe03b/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.208174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca75eb-8914-4bf0-b1de-b8fb41905bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c833c25fd945f1ad729d66bde51100, user_id=4fc58f7ca26240ef9c1e458dd5832a15, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.208174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca75eb-8914-4bf0-b1de-b8fb41905bdb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.208358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36921-4dbe-44c2-b2d9-67b0fed7e3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05196cf3447a4e17ac06976291ac4c92, user_id=0c3d791666e742e4915d4f52d8dbe03b, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.208358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36921-4dbe-44c2-b2d9-67b0fed7e3c1 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.208736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 795/1609] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:25 2022] PUT /identity/v3/projects/71c833c25fd945f1ad729d66bde51100/users/4fc58f7ca26240ef9c1e458dd5832a15/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:25.208736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300048d-b4f9-4875-a6f2-5554656af55c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.208736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300048d-b4f9-4875-a6f2-5554656af55c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.208736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300048d-b4f9-4875-a6f2-5554656af55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.213740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 815/1610] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:25 2022] PUT /identity/v3/projects/05196cf3447a4e17ac06976291ac4c92/users/0c3d791666e742e4915d4f52d8dbe03b/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:25.219298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb002b-2f06-4a6c-aa6a-626368a9a0c7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.219298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb002b-2f06-4a6c-aa6a-626368a9a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.219298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb002b-2f06-4a6c-aa6a-626368a9a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.245244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f2eb002b-2f06-4a6c-aa6a-626368a9a0c7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:25.246628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f2eb002b-2f06-4a6c-aa6a-626368a9a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:25.264851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a300048d-b4f9-4875-a6f2-5554656af55c None None] MFA Rules not processed for user `036e571e1c2f486f80a21a61b2c742cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:25.266235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a300048d-b4f9-4875-a6f2-5554656af55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:25.372496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 816/1611] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:25.372496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b719c-44c1-43a3-af92-f223a940fee3 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.372496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b719c-44c1-43a3-af92-f223a940fee3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.372496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b719c-44c1-43a3-af92-f223a940fee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.427043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-027b719c-44c1-43a3-af92-f223a940fee3 None None] MFA Rules not processed for user `269294e798284b368d4b7dabfcd58b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:25.428933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-027b719c-44c1-43a3-af92-f223a940fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:25.448557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 796/1612] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:25.451485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300048d-b4f9-4875-a6f2-5554656af55c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.477915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300048d-b4f9-4875-a6f2-5554656af55c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:25.491374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd3f73-4a9c-41b6-b52e-aea1cd0d8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:25.492279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd3f73-4a9c-41b6-b52e-aea1cd0d8afa admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.492577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd3f73-4a9c-41b6-b52e-aea1cd0d8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.492860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd3f73-4a9c-41b6-b52e-aea1cd0d8afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.493665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd3f73-4a9c-41b6-b52e-aea1cd0d8afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.495364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd3f73-4a9c-41b6-b52e-aea1cd0d8afa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.502642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:25.524905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 817/1613] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:25.524905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.525209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.525689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.527438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 797/1614] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:25.529286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e715-172b-4404-96ff-d8a5735ceed9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.531769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e715-172b-4404-96ff-d8a5735ceed9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.532113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e715-172b-4404-96ff-d8a5735ceed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.554731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:25.556465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:25.561559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4977e715-172b-4404-96ff-d8a5735ceed9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:25.562819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4977e715-172b-4404-96ff-d8a5735ceed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:25.571606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 818/1615] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:25.573332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.578431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:25.578750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 798/1616] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:25.582897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175fb06-155f-4909-bcc8-a6de8a8e9e12 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.582897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175fb06-155f-4909-bcc8-a6de8a8e9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.582897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175fb06-155f-4909-bcc8-a6de8a8e9e12 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.585077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 799/1617] 10.222.0.78 () {54 vars in 961 bytes} [Mon Jul 4 10:09:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:25.588894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175fb06-155f-4909-bcc8-a6de8a8e9e12 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.611693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175fb06-155f-4909-bcc8-a6de8a8e9e12 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:25.621718 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:25.623171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.623797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.624283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.625364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.629740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.673106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843de97-6d1f-40ea-9df3-91247f4835da None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:25.678442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66af6e-30ad-40b6-814e-3fb9472a8199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:25.680219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66af6e-30ad-40b6-814e-3fb9472a8199 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.680677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66af6e-30ad-40b6-814e-3fb9472a8199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.681349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66af6e-30ad-40b6-814e-3fb9472a8199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.693484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66af6e-30ad-40b6-814e-3fb9472a8199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.694547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 800/1618] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:25 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:25.695258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.696461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66af6e-30ad-40b6-814e-3fb9472a8199 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.700762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:25.712371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 819/1619] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:25.715900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1191-332b-4e80-881d-1f62d4cb5892 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.715900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1191-332b-4e80-881d-1f62d4cb5892 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.715900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1191-332b-4e80-881d-1f62d4cb5892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.741631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5cfd1191-332b-4e80-881d-1f62d4cb5892 None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:25.743404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5cfd1191-332b-4e80-881d-1f62d4cb5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:25.838577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a29dc-47c5-48a2-b287-8f6e04c52508 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:25.859745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:25.860812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:25.861102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:25.861384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] PATH_INFO: `/v3/projects/64e13d17d46347928ca24d3004d686d9/users/da9580a24b6a4213b0191fec7ab8a8c6/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:25.862509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 820/1620] 10.222.0.78 () {58 vars in 1058 bytes} [Mon Jul 4 10:09:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:25.863398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1191-332b-4e80-881d-1f62d4cb5892 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.890421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e13d17d46347928ca24d3004d686d9, user_id=da9580a24b6a4213b0191fec7ab8a8c6, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:25.893428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:25.920727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 801/1621] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:25 2022] PUT /identity/v3/projects/64e13d17d46347928ca24d3004d686d9/users/da9580a24b6a4213b0191fec7ab8a8c6/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:25.921436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:25.981771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1191-332b-4e80-881d-1f62d4cb5892 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.010726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e04a6a-90b0-49b8-9c18-6990e9671f46 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.019414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.020123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.020422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.021919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.039562 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:26.073603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.074433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.074729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.075012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.114253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.115787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.133216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 802/1622] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:26.134395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.160449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3189bb-f71b-4bd8-aba4-fc2f826c69a0 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.172106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.172959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.173806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.174093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.174800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.183172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.203443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.205029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.220996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 821/1623] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:26.226349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.233289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 803/1624] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:26 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:26.233289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.244579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581c262-cc44-455a-94bf-6907338f468b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.252748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.253429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.253721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.254006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.254744 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.256976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.269880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 804/1625] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:26.270774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.297249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82091f-ec9d-4484-8500-913fa62f41ce admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.308182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.309700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.309700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.309923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.312664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.316541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.318331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:26.336099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69ced-6327-4720-bb24-9adfe95d39e9 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.345629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 805/1626] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:26.345629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.348583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458cf0a-38fa-4334-ae68-1b000bde7884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.352268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458cf0a-38fa-4334-ae68-1b000bde7884 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.352562 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458cf0a-38fa-4334-ae68-1b000bde7884 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.352942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458cf0a-38fa-4334-ae68-1b000bde7884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.366942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab40d6-dddc-41f4-a3d8-e0632f8e82b3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.377008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.379512 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.379841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.380941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] PATH_INFO: `/v3/projects/64e13d17d46347928ca24d3004d686d9/users/da9580a24b6a4213b0191fec7ab8a8c6/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.385640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e13d17d46347928ca24d3004d686d9, user_id=da9580a24b6a4213b0191fec7ab8a8c6, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.391802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.414621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 806/1627] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:26 2022] PUT /identity/v3/projects/64e13d17d46347928ca24d3004d686d9/users/da9580a24b6a4213b0191fec7ab8a8c6/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:26.427622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.487884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458cf0a-38fa-4334-ae68-1b000bde7884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.490551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458cf0a-38fa-4334-ae68-1b000bde7884 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.530091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 822/1628] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:26.532203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581751-2c18-4396-9285-df1dec9cb048 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.534078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581751-2c18-4396-9285-df1dec9cb048 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.534412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d581751-2c18-4396-9285-df1dec9cb048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.536571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465427-4541-4644-892a-9e282cf788f6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.543848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.545997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.546483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.548150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] PATH_INFO: `/v3/projects/a4e27797edf94d64a73c1dce834d9d2e/users/88d5a52d7b0448ce86668647cffd5750/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.585381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e27797edf94d64a73c1dce834d9d2e, user_id=88d5a52d7b0448ce86668647cffd5750, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.589547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.611076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 807/1629] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:26 2022] PUT /identity/v3/projects/a4e27797edf94d64a73c1dce834d9d2e/users/88d5a52d7b0448ce86668647cffd5750/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:26.614792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.617346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1d581751-2c18-4396-9285-df1dec9cb048 None None] MFA Rules not processed for user `da9580a24b6a4213b0191fec7ab8a8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:26.618843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1d581751-2c18-4396-9285-df1dec9cb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:26.657910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:26.763945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a2e2b-fd06-480f-a2e3-88f7bf929869 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.780284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.781289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.781733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.782180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.783336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.785193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.811268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 823/1630] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:26.812516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f36da-1b28-4b7e-8503-657f7f1aba72 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.812791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f36da-1b28-4b7e-8503-657f7f1aba72 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.813081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f36da-1b28-4b7e-8503-657f7f1aba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.826159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 808/1631] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:26.827154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:26.850477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1563-6df1-45f4-a77c-886a9037c296 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:26.870275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:26.871301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:26.871589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:26.871878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] PATH_INFO: `/v3/projects/a4e27797edf94d64a73c1dce834d9d2e/users/88d5a52d7b0448ce86668647cffd5750/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:26.874051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e27797edf94d64a73c1dce834d9d2e, user_id=88d5a52d7b0448ce86668647cffd5750, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:26.876785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:26.898310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-816f36da-1b28-4b7e-8503-657f7f1aba72 None None] MFA Rules not processed for user `18437c56cc874e44bda0c2974718856c`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:26.899725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-816f36da-1b28-4b7e-8503-657f7f1aba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:26.906176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 809/1632] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:26 2022] PUT /identity/v3/projects/a4e27797edf94d64a73c1dce834d9d2e/users/88d5a52d7b0448ce86668647cffd5750/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:26.907051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:27.030317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:27.035472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d659a-c890-499d-be64-c411d72b0244 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:27.047997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd6153-3ce0-44ee-914a-f4fed54b686d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:27.048679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6153-3ce0-44ee-914a-f4fed54b686d service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.049050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6153-3ce0-44ee-914a-f4fed54b686d service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.049337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6153-3ce0-44ee-914a-f4fed54b686d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:27.080008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 824/1633] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:27.081651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c098a92-6c00-49cd-9245-072c75e82262 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.082411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c098a92-6c00-49cd-9245-072c75e82262 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.083056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c098a92-6c00-49cd-9245-072c75e82262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:27.143872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3c098a92-6c00-49cd-9245-072c75e82262 None None] MFA Rules not processed for user `88d5a52d7b0448ce86668647cffd5750`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:27.147757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3c098a92-6c00-49cd-9245-072c75e82262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:27.187355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd6153-3ce0-44ee-914a-f4fed54b686d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:27.190499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd6153-3ce0-44ee-914a-f4fed54b686d service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:27.219952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 810/1634] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:27.221530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac696c16-5a85-435c-bdb1-2d2b3760fd72 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.221823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac696c16-5a85-435c-bdb1-2d2b3760fd72 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.222107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac696c16-5a85-435c-bdb1-2d2b3760fd72 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:27.229711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 811/1635] 10.222.0.78 () {54 vars in 912 bytes} [Mon Jul 4 10:09:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:27.230627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac696c16-5a85-435c-bdb1-2d2b3760fd72 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:27.376935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 825/1636] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:27.379214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6c54d-03e2-4e62-8579-6b6f48b7910b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.379214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6c54d-03e2-4e62-8579-6b6f48b7910b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.386441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6c54d-03e2-4e62-8579-6b6f48b7910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:27.430015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-58d6c54d-03e2-4e62-8579-6b6f48b7910b None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:27.432563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-58d6c54d-03e2-4e62-8579-6b6f48b7910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:27.453211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac696c16-5a85-435c-bdb1-2d2b3760fd72 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:27.458705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:27.459763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.459943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.460172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:27.460879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:27.462803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:27.484200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:27.534823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 812/1637] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:27 2022] POST /identity/v3/projects => generated 405 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:27.535704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:27.597762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 826/1638] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:09:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:27.598821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6c54d-03e2-4e62-8579-6b6f48b7910b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:27.620963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6c54d-03e2-4e62-8579-6b6f48b7910b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:27.672195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dde9e3-9ba7-4d14-b975-18336a6d5652 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:27.687026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:27.687892 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.687995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.688271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:27.734012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:27.734918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.735292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.735687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:27.740622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:27.781759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:27.786802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:27.814477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 813/1639] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:27.817415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:27.900307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:27.901934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:27.942070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 827/1640] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:27.942967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:27.970872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6264e-6686-438e-a883-12ee48a89024 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:27.982692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:27.983409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:27.983724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:27.984192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:28.018658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1813e8-ec74-4031-98ad-457a554e1879 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:28.035778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:28.036742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:28.038345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:28.040087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:28.044503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:28.050832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:28.083199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:28.085207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:28.098485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:28.103797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 814/1641] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:27 2022] POST /identity/v3/users => generated 309 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:28.104922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:28.116186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 828/1642] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:28.130787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bdc4a-17e5-420f-928d-bceab5db0eb6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:28.143809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:28.145291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:28.146730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:28.147027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:28.148226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:28.153025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:28.183351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 815/1643] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:28.183815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:28.196699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979ec88-c0a2-44f0-8137-48f3f5b4517b service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:28.203320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:28.204329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:28.205015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:28.205348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] PATH_INFO: `/v3/projects/c409e9a4f18d4ab6bcd362a0947a5368/users/0caa16c5efbe49899a2b2bfe216ddd36/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:28.236489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c409e9a4f18d4ab6bcd362a0947a5368, user_id=0caa16c5efbe49899a2b2bfe216ddd36, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:28.245156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:28.274468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 829/1644] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:28 2022] PUT /identity/v3/projects/c409e9a4f18d4ab6bcd362a0947a5368/users/0caa16c5efbe49899a2b2bfe216ddd36/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:09:28.278439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:28.295848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafb187-99cd-447f-b8a0-870d7caf8da7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:28.421490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:28.422527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:28.422904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:28.423598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:28.424454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:28.449038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:28.468679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 816/1645] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:28.472962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:28.489631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3de37c-b84c-4d3e-82a9-fcf534ce58dc admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:28.498753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65341-d048-4b67-9466-8e89db25d46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:28.500644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65341-d048-4b67-9466-8e89db25d46b admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:28.500858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65341-d048-4b67-9466-8e89db25d46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:28.501188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65341-d048-4b67-9466-8e89db25d46b admin admin] PATH_INFO: `/v3/projects/c409e9a4f18d4ab6bcd362a0947a5368/users/0caa16c5efbe49899a2b2bfe216ddd36/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:28.503750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65341-d048-4b67-9466-8e89db25d46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c409e9a4f18d4ab6bcd362a0947a5368, user_id=0caa16c5efbe49899a2b2bfe216ddd36, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:28.507845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65341-d048-4b67-9466-8e89db25d46b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:28.525696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 830/1646] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:28 2022] PUT /identity/v3/projects/c409e9a4f18d4ab6bcd362a0947a5368/users/0caa16c5efbe49899a2b2bfe216ddd36/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:28.604773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:28.702628 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:28.724615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b59a0c-ee8a-41e3-ad2a-b32205449b95 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:28.886565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbd23d-5a1b-4da5-a44b-6aebf2e85a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:28.887363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbd23d-5a1b-4da5-a44b-6aebf2e85a79 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:28.890986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbd23d-5a1b-4da5-a44b-6aebf2e85a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:28.891361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbd23d-5a1b-4da5-a44b-6aebf2e85a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:29.016075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbd23d-5a1b-4da5-a44b-6aebf2e85a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:29.018022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbd23d-5a1b-4da5-a44b-6aebf2e85a79 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:29.055208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 817/1647] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:30.009536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80406994-f871-4d1c-b8f7-0b09e0f323d5 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:30.011906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80406994-f871-4d1c-b8f7-0b09e0f323d5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:30.014081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80406994-f871-4d1c-b8f7-0b09e0f323d5 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:30.014975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 831/1648] 10.222.0.78 () {54 vars in 961 bytes} [Mon Jul 4 10:09:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:30.024330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cdd99-7d56-4a4f-a010-10dc3c01dd9e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:30.025805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cdd99-7d56-4a4f-a010-10dc3c01dd9e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:30.026234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cdd99-7d56-4a4f-a010-10dc3c01dd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:30.072857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ff5cdd99-7d56-4a4f-a010-10dc3c01dd9e None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:30.076808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ff5cdd99-7d56-4a4f-a010-10dc3c01dd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:30.180480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370b98d-32f7-4220-a5d8-1643bd6590ad None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:30.181010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370b98d-32f7-4220-a5d8-1643bd6590ad None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:30.181560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370b98d-32f7-4220-a5d8-1643bd6590ad None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:30.184731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 832/1649] 10.222.0.78 () {54 vars in 912 bytes} [Mon Jul 4 10:09:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:30.191796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047846c5-0c52-44c0-ae42-81bd3d6a73a5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:30.192190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047846c5-0c52-44c0-ae42-81bd3d6a73a5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:30.192470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047846c5-0c52-44c0-ae42-81bd3d6a73a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:30.196645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 818/1650] 10.222.0.78 () {58 vars in 1058 bytes} [Mon Jul 4 10:09:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:30.215426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-047846c5-0c52-44c0-ae42-81bd3d6a73a5 None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:30.217347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-047846c5-0c52-44c0-ae42-81bd3d6a73a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:30.234125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 833/1651] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:09:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:09:30.248784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cdd99-7d56-4a4f-a010-10dc3c01dd9e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:30.259432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cdd99-7d56-4a4f-a010-10dc3c01dd9e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:30.264913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:30.265940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:30.265940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:30.266342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:30.288641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:30.291632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:30.312533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 819/1652] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:31.469220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a87d2-c0b9-4bde-b5f2-c3ac57e7759c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:31.469862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a87d2-c0b9-4bde-b5f2-c3ac57e7759c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:31.469989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a87d2-c0b9-4bde-b5f2-c3ac57e7759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:31.540068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5c1a87d2-c0b9-4bde-b5f2-c3ac57e7759c None None] MFA Rules not processed for user `ab81044ba8c54e8d808c4aed5a659929`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:31.544285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5c1a87d2-c0b9-4bde-b5f2-c3ac57e7759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:31.744124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:31.758548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 834/1653] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:31.765429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad12d3-94f6-4cec-8dd4-feb537846a27 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:31.777899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:31.780992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:31.782126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:31.782732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:31.815446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:31.817714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:31.849363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb3be-3964-476d-a4c6-fb1e5fe18559 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:31.849740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb3be-3964-476d-a4c6-fb1e5fe18559 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:31.850236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb3be-3964-476d-a4c6-fb1e5fe18559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:31.851167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 820/1654] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:09:31.926052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1bbfb3be-3964-476d-a4c6-fb1e5fe18559 None None] MFA Rules not processed for user `0caa16c5efbe49899a2b2bfe216ddd36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:31.927344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1bbfb3be-3964-476d-a4c6-fb1e5fe18559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:32.080083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 835/1655] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:35.408147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:35.489634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:35.507973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b326-c9c7-423c-84fd-5d5dc76031b1 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:35.508510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b326-c9c7-423c-84fd-5d5dc76031b1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:35.508510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b326-c9c7-423c-84fd-5d5dc76031b1 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:35.510075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 836/1656] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:35.565114 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4458ae2-5f82-428a-869b-24961076a240 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:35.565404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4458ae2-5f82-428a-869b-24961076a240 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:35.566462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4458ae2-5f82-428a-869b-24961076a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:35.617320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d4458ae2-5f82-428a-869b-24961076a240 None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:35.618610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d4458ae2-5f82-428a-869b-24961076a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:35.620650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6486-73ca-4de8-808f-a2ef474549f6 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:35.632172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:35.635303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:35.635617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:35.635935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] PATH_INFO: `/v3/users/036e571e1c2f486f80a21a61b2c742cf` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:35.646118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036e571e1c2f486f80a21a61b2c742cf)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:35.647262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: WARNING py.warnings [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:09:35.647262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: warnings.warn(msg) Jul 04 10:09:35.647262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: Jul 04 10:09:35.648425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:35.669374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:35.730459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 837/1657] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:35.817858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036e571e1c2f486f80a21a61b2c742cf'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:35.818738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036e571e1c2f486f80a21a61b2c742cf'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:35.844273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036e571e1c2f486f80a21a61b2c742cf'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:35.864327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036e571e1c2f486f80a21a61b2c742cf'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:35.865300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aeb9ef-a33c-4f47-afc5-a7be01c75596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036e571e1c2f486f80a21a61b2c742cf'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:35.944840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 821/1658] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:35 2022] DELETE /identity/v3/users/036e571e1c2f486f80a21a61b2c742cf => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:35.946777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5b86f-faa4-4747-adab-302d38b4922a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:35.947151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5b86f-faa4-4747-adab-302d38b4922a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:35.948125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5b86f-faa4-4747-adab-302d38b4922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:35.977239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192925f4-83f2-43df-87f0-0eea02079981 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:35.977562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192925f4-83f2-43df-87f0-0eea02079981 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:35.977643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192925f4-83f2-43df-87f0-0eea02079981 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:35.979019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 822/1659] 10.222.0.78 () {54 vars in 960 bytes} [Mon Jul 4 10:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:35.987157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:35.988213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:35.988711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:35.994334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-58a5b86f-faa4-4747-adab-302d38b4922a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:35.996648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-58a5b86f-faa4-4747-adab-302d38b4922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:36.058817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:36.062478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:36.266851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 838/1660] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:36.269836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 823/1661] 10.222.0.78 () {58 vars in 1057 bytes} [Mon Jul 4 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:36.282698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5b86f-faa4-4747-adab-302d38b4922a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:36.310664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5b86f-faa4-4747-adab-302d38b4922a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:36.336204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:36.337627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:36.338016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:36.338364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:36.345210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:36.375872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:36.386926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:36.419384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 839/1662] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:36.496164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:36.498375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:36.633407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:36.676862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544d1b6-6c55-42ed-8451-af5cb7131917 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:36.690690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905072f1-c8b0-49e5-be4e-625a3d06f59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:36.691617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905072f1-c8b0-49e5-be4e-625a3d06f59a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:36.692756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905072f1-c8b0-49e5-be4e-625a3d06f59a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:36.693229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905072f1-c8b0-49e5-be4e-625a3d06f59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:36.708388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905072f1-c8b0-49e5-be4e-625a3d06f59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:36.710844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905072f1-c8b0-49e5-be4e-625a3d06f59a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:36.736384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 824/1663] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:37.993461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:37.996567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:38.050937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7989a8-d35e-4396-8dc7-f737ffab6647 service placement] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:38.067894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:38.069429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:38.069857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:38.070274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] PATH_INFO: `/v3/users/269294e798284b368d4b7dabfcd58b44` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:38.072168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=269294e798284b368d4b7dabfcd58b44)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:38.084912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:38.192061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269294e798284b368d4b7dabfcd58b44'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:38.212355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269294e798284b368d4b7dabfcd58b44'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:38.213194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269294e798284b368d4b7dabfcd58b44'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:38.213920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269294e798284b368d4b7dabfcd58b44'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:38.224347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269294e798284b368d4b7dabfcd58b44'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:38.250973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 840/1664] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:37 2022] DELETE /identity/v3/users/269294e798284b368d4b7dabfcd58b44 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:38.255455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757171-9d94-4f4b-b595-acc015ebbc97 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:38.256296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757171-9d94-4f4b-b595-acc015ebbc97 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:38.256750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac757171-9d94-4f4b-b595-acc015ebbc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:38.300135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ac757171-9d94-4f4b-b595-acc015ebbc97 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:38.301612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ac757171-9d94-4f4b-b595-acc015ebbc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:38.406315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 825/1665] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:38.432402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:38.433907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:38.499801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:38.586740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a24cb-64b8-40ee-a401-0f53fe10d16e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:38.631491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:38.634624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:38.638935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:38.651847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:38.674597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e7599-afe5-45b8-b60e-352c322ea992 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:38.674893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e7599-afe5-45b8-b60e-352c322ea992 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:38.675227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e7599-afe5-45b8-b60e-352c322ea992 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:38.676844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 826/1666] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 10:09:38.678611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:38.684365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:38.691788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:38.692281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:38.692766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:38.711738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 841/1667] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:38.727869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] MFA Rules not processed for user `3fe12b3ec01547eba1493e7a179c8af9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:38.729452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:38.952721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 827/1668] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:09:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:09:38.989070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:38.997053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:39.024671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:39.026142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:39.063843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc4b8-64e5-4e53-815e-c7b72dc4394d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:39.065860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fd4fc-01f8-4e2f-b220-c277f3a63e25 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:39.083474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:39.092011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:39.092456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:39.092817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350b41-f627-43e7-a132-1682bdca32d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:39.093485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350b41-f627-43e7-a132-1682bdca32d6 service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:39.093771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350b41-f627-43e7-a132-1682bdca32d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:39.094047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350b41-f627-43e7-a132-1682bdca32d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:39.094974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] PATH_INFO: `/v3/users/18437c56cc874e44bda0c2974718856c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:39.096603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18437c56cc874e44bda0c2974718856c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:39.098767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:39.113799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350b41-f627-43e7-a132-1682bdca32d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:39.115423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350b41-f627-43e7-a132-1682bdca32d6 service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:39.142633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 842/1669] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:39.225066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18437c56cc874e44bda0c2974718856c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:39.226374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18437c56cc874e44bda0c2974718856c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:39.243370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18437c56cc874e44bda0c2974718856c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:39.254236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18437c56cc874e44bda0c2974718856c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:39.255004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18437c56cc874e44bda0c2974718856c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:39.277510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:39.295510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 828/1670] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:39 2022] DELETE /identity/v3/users/18437c56cc874e44bda0c2974718856c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:09:39.720813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c68a-28ec-47f7-b7e7-a247fcd23332 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:39.721212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c68a-28ec-47f7-b7e7-a247fcd23332 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:39.721643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c68a-28ec-47f7-b7e7-a247fcd23332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:39.757001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-dfb8c68a-28ec-47f7-b7e7-a247fcd23332 None None] MFA Rules not processed for user `ab81044ba8c54e8d808c4aed5a659929`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:39.760046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-dfb8c68a-28ec-47f7-b7e7-a247fcd23332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:39.958578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 843/1671] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:40.007846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:40.014824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:40.212450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c261-7307-4efb-a189-baeb1ace7915 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:40.225817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:40.226938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:40.229784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:40.230341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] PATH_INFO: `/v3/projects/ed9172304b2140c780cf8a55506b17cd` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:40.233412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9172304b2140c780cf8a55506b17cd)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:40.236923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:40.391986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9172304b2140c780cf8a55506b17cd', 'request_id': 'req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:40.413885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9172304b2140c780cf8a55506b17cd', 'request_id': 'req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:40.424165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9172304b2140c780cf8a55506b17cd', 'request_id': 'req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:40.463862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] The token cache is being invalidate because project ed9172304b2140c780cf8a55506b17cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:09:40.464975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:40.464975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6f7cad8d-0db8-4e9f-8cb8-8050a8deb788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:40.491214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 829/1672] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:09:40 2022] DELETE /identity/v3/projects/ed9172304b2140c780cf8a55506b17cd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:40.495434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c756e4-9be3-4a23-aa89-e0965e854edd None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:40.496308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c756e4-9be3-4a23-aa89-e0965e854edd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:40.496729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c756e4-9be3-4a23-aa89-e0965e854edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:40.549081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-00c756e4-9be3-4a23-aa89-e0965e854edd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:40.550307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-00c756e4-9be3-4a23-aa89-e0965e854edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:40.714423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 844/1673] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:40.718316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b262-9ef9-4b53-b265-e7712171c813 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:40.725218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b262-9ef9-4b53-b265-e7712171c813 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:40.726310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b262-9ef9-4b53-b265-e7712171c813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:40.771193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-09c3b262-9ef9-4b53-b265-e7712171c813 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:40.773319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-09c3b262-9ef9-4b53-b265-e7712171c813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:40.795202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 830/1674] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:40.795378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c756e4-9be3-4a23-aa89-e0965e854edd None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:40.808669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c756e4-9be3-4a23-aa89-e0965e854edd None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:40.851301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:40.852505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:40.853151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:40.853811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:40.855399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:40.856188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:40.859257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:40.888691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3b262-9ef9-4b53-b265-e7712171c813 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:40.898440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 845/1675] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:09:40.904925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3b262-9ef9-4b53-b265-e7712171c813 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:40.932934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011a9aa-d81a-41b3-98cd-cc15fb3b3f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:40.934138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a9aa-d81a-41b3-98cd-cc15fb3b3f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:40.935177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a9aa-d81a-41b3-98cd-cc15fb3b3f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:40.935783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a9aa-d81a-41b3-98cd-cc15fb3b3f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:40.936698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011a9aa-d81a-41b3-98cd-cc15fb3b3f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:40.940421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011a9aa-d81a-41b3-98cd-cc15fb3b3f8b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:41.010200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:41.020418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 831/1676] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:40 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:41.024208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385bd98-8413-4733-956a-a6c5dbbe21e8 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:41.116181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:41.140862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec007c-9f31-4f3b-8bec-67f37d45f191 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.143562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec007c-9f31-4f3b-8bec-67f37d45f191 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.145290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec007c-9f31-4f3b-8bec-67f37d45f191 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.150081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 832/1677] 10.222.0.78 () {54 vars in 912 bytes} [Mon Jul 4 10:09:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:41.156368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e303-7897-4a90-9b1e-c6cc845f4817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:41.157439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e303-7897-4a90-9b1e-c6cc845f4817 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.157746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659b991-0d6d-44cf-b5ba-70a4a75c77b8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.158290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659b991-0d6d-44cf-b5ba-70a4a75c77b8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.158657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659b991-0d6d-44cf-b5ba-70a4a75c77b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.158820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e303-7897-4a90-9b1e-c6cc845f4817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.160732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e303-7897-4a90-9b1e-c6cc845f4817 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.161576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e303-7897-4a90-9b1e-c6cc845f4817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:41.165796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e303-7897-4a90-9b1e-c6cc845f4817 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:41.213864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 846/1678] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:41 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:41.216333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.216919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.217337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.228376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2659b991-0d6d-44cf-b5ba-70a4a75c77b8 None None] MFA Rules not processed for user `a5b5399fad924cabaf1d414bbca2c191`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:41.229659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2659b991-0d6d-44cf-b5ba-70a4a75c77b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:41.253055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] MFA Rules not processed for user `0c3d791666e742e4915d4f52d8dbe03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:41.254189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:41.294867 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:41.373390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 833/1679] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:41.374225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659b991-0d6d-44cf-b5ba-70a4a75c77b8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:41.387045 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659b991-0d6d-44cf-b5ba-70a4a75c77b8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:41.394193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:41.394884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.395167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.395442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.396376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:41.399140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:41.402991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 847/1680] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:41.404267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:41.406277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:41.427941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 834/1681] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:41.427941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:41.431919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:41.433619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c9b40-c83b-4655-8d90-9530b3196b64 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:41.441797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:41.443145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.443709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.444469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] PATH_INFO: `/v3/projects/566ac6158a1844aab5a14fab8f5a5e33` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.446895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566ac6158a1844aab5a14fab8f5a5e33)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:41.448405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: WARNING py.warnings [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 10:09:41.448405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: warnings.warn(msg) Jul 04 10:09:41.448405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: Jul 04 10:09:41.450277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:41.472843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1cc2-4c10-4299-bb1c-c5be15583347 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:41.485420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:41.485420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.485420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.485420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.500460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:41.503472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:41.525543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 835/1682] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:41.526131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:41.530340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:41.566580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566ac6158a1844aab5a14fab8f5a5e33', 'request_id': 'req-68d3c8a3-18d0-407e-84e7-6c45e04984d9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:41.586215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566ac6158a1844aab5a14fab8f5a5e33', 'request_id': 'req-68d3c8a3-18d0-407e-84e7-6c45e04984d9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:41.617091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566ac6158a1844aab5a14fab8f5a5e33', 'request_id': 'req-68d3c8a3-18d0-407e-84e7-6c45e04984d9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:41.647259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] The token cache is being invalidate because project 566ac6158a1844aab5a14fab8f5a5e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:09:41.647711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:41.648428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:41.650174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 848/1683] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:09:41 2022] DELETE /identity/v3/projects/566ac6158a1844aab5a14fab8f5a5e33 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:41.654398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:41.659755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:41.706410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7ab9-eb6d-479f-a95e-aa9fe3d7b76e service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:41.830848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:41.870253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c8a3-18d0-407e-84e7-6c45e04984d9 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:41.896266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:41.897123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.897412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.897767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.902023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:41.904365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:41.933272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:41.934196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:41.934697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:41.934985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:41.937884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:41.945864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 849/1684] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:41.948712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:41.957304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:42.003399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bbc16-dcba-4af7-b6d7-d4cc43c67085 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:42.021092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:42.021986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:42.022273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:42.022548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] PATH_INFO: `/v3/users/0caa16c5efbe49899a2b2bfe216ddd36` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:42.030720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0caa16c5efbe49899a2b2bfe216ddd36)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:42.032964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:42.140571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:42.144629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:42.161930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:42.171226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 836/1685] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:42.173086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:42.186617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0caa16c5efbe49899a2b2bfe216ddd36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.209493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0caa16c5efbe49899a2b2bfe216ddd36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.210584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0caa16c5efbe49899a2b2bfe216ddd36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.211170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0caa16c5efbe49899a2b2bfe216ddd36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.219438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775632-f8ed-4733-9d6e-f380e40f779e service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:42.234407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5cd16f53-5b96-4586-b344-e43362956295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0caa16c5efbe49899a2b2bfe216ddd36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.246885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:42.254853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:42.259114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:42.259507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] PATH_INFO: `/v3/projects/51480b1c51104c398a37e7e757a62cd8/users/8625f2bd4603450c8e5d504702db237a/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:42.311096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51480b1c51104c398a37e7e757a62cd8, user_id=8625f2bd4603450c8e5d504702db237a, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:42.323467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:42.364963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 837/1686] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:42 2022] PUT /identity/v3/projects/51480b1c51104c398a37e7e757a62cd8/users/8625f2bd4603450c8e5d504702db237a/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:42.367902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:42.375808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:42.396831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 850/1687] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:41 2022] DELETE /identity/v3/users/0caa16c5efbe49899a2b2bfe216ddd36 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:42.398843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:42.398843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:42.398843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:42.458386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] MFA Rules not processed for user `8625f2bd4603450c8e5d504702db237a`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:42.462080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:42.608922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561b7d5-a9f7-4798-a048-dff5f4179d34 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:42.635519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 851/1688] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:42.647596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:42.650065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:42.738591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:42.740952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:42.741183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:42.741740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] PATH_INFO: `/v3/projects/1d63a78240934c4787d7ee23555a488e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:42.746051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d63a78240934c4787d7ee23555a488e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:42.749893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:42.832393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:42.848027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d63a78240934c4787d7ee23555a488e', 'request_id': 'req-95832e3a-8387-4d2d-82a1-78b27a22285c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.850069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7318df-8725-4354-a8a1-3948397d80f8 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:42.868952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d63a78240934c4787d7ee23555a488e', 'request_id': 'req-95832e3a-8387-4d2d-82a1-78b27a22285c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.884334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d63a78240934c4787d7ee23555a488e', 'request_id': 'req-95832e3a-8387-4d2d-82a1-78b27a22285c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.905893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] The token cache is being invalidate because project 1d63a78240934c4787d7ee23555a488e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:09:42.906199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.907265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:42.914957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 838/1689] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:09:42 2022] DELETE /identity/v3/projects/1d63a78240934c4787d7ee23555a488e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:42.914957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:42.918025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:42.962627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:43.032563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:43.033296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.033587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.035328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.040535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:43.147466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832e3a-8387-4d2d-82a1-78b27a22285c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:43.157833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:43.160604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.161127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.161584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.164013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:43.184763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:43.189776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:43.216746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:43.218427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:43.221345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 839/1690] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:43.222226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:43.240605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:43.250691 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 852/1691] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:09:43.251648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:43.255158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:43.394495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c3165-dd38-4d8d-acc0-52ce809f7f44 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:43.415204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:43.416259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.416539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.416821 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] PATH_INFO: `/v3/users/88d5a52d7b0448ce86668647cffd5750` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.425893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d5a52d7b0448ce86668647cffd5750)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:43.429938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e817b-f0a5-42ee-a6b0-efaf29fac4a1 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:43.433441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:43.439143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:43.440065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.440351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.440619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] PATH_INFO: `/v3/projects/c409e9a4f18d4ab6bcd362a0947a5368` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.444172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c409e9a4f18d4ab6bcd362a0947a5368)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:43.447533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:43.527065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d5a52d7b0448ce86668647cffd5750'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.527963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d5a52d7b0448ce86668647cffd5750'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.556868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d5a52d7b0448ce86668647cffd5750'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.568313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c409e9a4f18d4ab6bcd362a0947a5368', 'request_id': 'req-34942669-8d5f-499c-9786-6c5ef3be115e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.572576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d5a52d7b0448ce86668647cffd5750'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.576043 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a021437b-ff41-4ae0-9076-9ebacc2dbec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d5a52d7b0448ce86668647cffd5750'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.585606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c409e9a4f18d4ab6bcd362a0947a5368', 'request_id': 'req-34942669-8d5f-499c-9786-6c5ef3be115e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.601163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:43.606538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c409e9a4f18d4ab6bcd362a0947a5368', 'request_id': 'req-34942669-8d5f-499c-9786-6c5ef3be115e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.626509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 840/1692] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:43 2022] DELETE /identity/v3/users/88d5a52d7b0448ce86668647cffd5750 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:43.633609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] The token cache is being invalidate because project c409e9a4f18d4ab6bcd362a0947a5368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:09:43.633973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.634676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34942669-8d5f-499c-9786-6c5ef3be115e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:43.641650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 853/1693] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:09:43 2022] DELETE /identity/v3/projects/c409e9a4f18d4ab6bcd362a0947a5368 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:43.647168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06ad7-f1e1-4092-8dc2-593b38c00116 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.647758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06ad7-f1e1-4092-8dc2-593b38c00116 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.648281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd06ad7-f1e1-4092-8dc2-593b38c00116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.703896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1fd06ad7-f1e1-4092-8dc2-593b38c00116 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:43.705456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1fd06ad7-f1e1-4092-8dc2-593b38c00116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:43.725844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:43.804550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 841/1694] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:43.810423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6cb1a-cc7b-447e-8966-1d39d6fa635b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.810991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6cb1a-cc7b-447e-8966-1d39d6fa635b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.811421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6cb1a-cc7b-447e-8966-1d39d6fa635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.858328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9bb6cb1a-cc7b-447e-8966-1d39d6fa635b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:43.861894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9bb6cb1a-cc7b-447e-8966-1d39d6fa635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:43.885740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 854/1695] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:43.890560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd06ad7-f1e1-4092-8dc2-593b38c00116 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:43.905111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd06ad7-f1e1-4092-8dc2-593b38c00116 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:43.916947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:43.918898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.919427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.919753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.921739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:43.923647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:43.926951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:43.961875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 842/1696] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:43.964033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6cb1a-cc7b-447e-8966-1d39d6fa635b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:43.976678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6cb1a-cc7b-447e-8966-1d39d6fa635b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:43.986544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:43.988468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:43.988672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:43.988954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:43.990851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:44.001229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:44.097414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 855/1697] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:43 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:09:44.101376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:44.113933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f787-ba87-4bad-829f-678eb22595c4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:44.368692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:44.370931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.371260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.372795 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.374720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:44.381154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:44.433183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 843/1698] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:44 2022] POST /identity/v3/users => generated 287 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:44.434418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:44.455764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099268cd-848c-4b9c-aa41-7b6568a7fbef admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:44.470535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:44.471481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.471800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.472096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.472975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:44.480438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:44.501412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 856/1699] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:44.505155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:44.517434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:44.526370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:44.534615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569316-848c-4975-9ebb-247501d3de6b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:44.546963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:44.547940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.549800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.550078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.553020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:44.555971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:44.561384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8246-3927-462b-a248-c736e2a60203 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:44.574294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:44.577560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.578594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.579354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] PATH_INFO: `/v3/projects/a4e27797edf94d64a73c1dce834d9d2e` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.584861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e27797edf94d64a73c1dce834d9d2e)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:44.593943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 844/1700] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:44.594519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:44.597363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:44.628529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d62c-b9e0-4fb5-b7c7-c92f25d25863 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:44.641274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f464f-51a0-4dea-a00f-467b9c38bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:44.645084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f464f-51a0-4dea-a00f-467b9c38bccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.646226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f464f-51a0-4dea-a00f-467b9c38bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.647014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f464f-51a0-4dea-a00f-467b9c38bccb admin admin] PATH_INFO: `/v3/projects/93089c1e05414fd7a17c5c3e95494a43/users/0f386875d6e248e08e66d87b14945ac8/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.700329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f464f-51a0-4dea-a00f-467b9c38bccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=93089c1e05414fd7a17c5c3e95494a43, user_id=0f386875d6e248e08e66d87b14945ac8, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:44.703775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f464f-51a0-4dea-a00f-467b9c38bccb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:44.711986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e27797edf94d64a73c1dce834d9d2e', 'request_id': 'req-d5f11991-43af-4dd1-b117-c7a31968c3ee'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:44.724907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e27797edf94d64a73c1dce834d9d2e', 'request_id': 'req-d5f11991-43af-4dd1-b117-c7a31968c3ee'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:44.733265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 845/1701] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:44 2022] PUT /identity/v3/projects/93089c1e05414fd7a17c5c3e95494a43/users/0f386875d6e248e08e66d87b14945ac8/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:44.748689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.750315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e27797edf94d64a73c1dce834d9d2e', 'request_id': 'req-d5f11991-43af-4dd1-b117-c7a31968c3ee'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:44.750509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.750884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.790860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] The token cache is being invalidate because project a4e27797edf94d64a73c1dce834d9d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:09:44.791507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:44.793617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d5f11991-43af-4dd1-b117-c7a31968c3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:44.802198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 857/1702] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:09:44 2022] DELETE /identity/v3/projects/a4e27797edf94d64a73c1dce834d9d2e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:44.803907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a77c-56ac-4827-a34f-96c585bc0045 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.804290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a77c-56ac-4827-a34f-96c585bc0045 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.804685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a77c-56ac-4827-a34f-96c585bc0045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.830844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] MFA Rules not processed for user `0f386875d6e248e08e66d87b14945ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:44.832557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:44.843024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a1f2a77c-56ac-4827-a34f-96c585bc0045 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:44.846857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a1f2a77c-56ac-4827-a34f-96c585bc0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:44.917883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:44.929934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 846/1703] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:44.944338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:44.950535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:44.967213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 858/1704] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:44.969187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce477-21cb-42a6-acf0-c8dd0a9e5cbc None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:44.969558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce477-21cb-42a6-acf0-c8dd0a9e5cbc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:44.969987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce477-21cb-42a6-acf0-c8dd0a9e5cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:44.983212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628cdfc-5438-46fc-a829-785fe5956da3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.001745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d67ce477-21cb-42a6-acf0-c8dd0a9e5cbc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:45.001745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d67ce477-21cb-42a6-acf0-c8dd0a9e5cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:45.002030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.002030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.002030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.002030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.002331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.004796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.013777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 859/1705] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:45.015033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce477-21cb-42a6-acf0-c8dd0a9e5cbc None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.029096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce477-21cb-42a6-acf0-c8dd0a9e5cbc None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.034978 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.035826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.036181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.036530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.038093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:45.038482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.040688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.056587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 860/1706] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:45.062321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.068585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 847/1707] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:45.072567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.078060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356765e2-2d55-4077-8824-a68dcb846244 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.088910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:45.212549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5b3b7-c1ab-475f-ba78-1679824032f9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.220202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.221183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.221630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.222005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.222911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.226592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.268262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 848/1708] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:45 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:45.272584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.298844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.299156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e496a-b396-4fdf-a32f-8a8b4147e70e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.299245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.299245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.299245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.299245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.299529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.300318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.300613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.300931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.301745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.303946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.308693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.341906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 849/1709] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:45.350046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.389739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d11ffd-768c-4413-84aa-40a2e0832b6d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.403512 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.405106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.405568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.406188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] PATH_INFO: `/v3/projects/5b0f111e86d34bd59b5c0c93269f05fe/users/8950de12b04a4d13946c18f99f2755ea/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.419821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 861/1710] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:45 2022] POST /identity/v3/projects => generated 379 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:45.424514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.476123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f111e86d34bd59b5c0c93269f05fe, user_id=8950de12b04a4d13946c18f99f2755ea, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.485792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.570508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 850/1711] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:45 2022] PUT /identity/v3/projects/5b0f111e86d34bd59b5c0c93269f05fe/users/8950de12b04a4d13946c18f99f2755ea/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:45.578885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.764243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc86cce-284e-4b23-bcb3-fde77cf3b789 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.877558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4adb2f-0501-4e53-8e28-f1cd9c912202 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.890731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.893178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.894846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.895769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.896658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.902353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.925893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 851/1712] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:45.932538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:45.951341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.952967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.953377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.954221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.955728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916da1b5-265d-42cb-bff1-fdd6c274a62e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:45.956496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.962089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.968838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40841b20-8e50-4488-a13e-fc3b1c5d955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:45.969897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841b20-8e50-4488-a13e-fc3b1c5d955d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:45.970198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841b20-8e50-4488-a13e-fc3b1c5d955d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:45.970553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841b20-8e50-4488-a13e-fc3b1c5d955d admin admin] PATH_INFO: `/v3/projects/5b0f111e86d34bd59b5c0c93269f05fe/users/8950de12b04a4d13946c18f99f2755ea/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:45.972714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40841b20-8e50-4488-a13e-fc3b1c5d955d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f111e86d34bd59b5c0c93269f05fe, user_id=8950de12b04a4d13946c18f99f2755ea, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:45.977124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40841b20-8e50-4488-a13e-fc3b1c5d955d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:45.991736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 862/1713] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:45 2022] POST /identity/v3/users => generated 290 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:46.001601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 852/1714] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:45 2022] PUT /identity/v3/projects/5b0f111e86d34bd59b5c0c93269f05fe/users/8950de12b04a4d13946c18f99f2755ea/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:46.001881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:46.014296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c0319-260e-4de3-b7e6-f7d3e875930e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:46.019843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:46.020300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:46.021344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:46.069861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:46.073266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:46.111236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] MFA Rules not processed for user `8950de12b04a4d13946c18f99f2755ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:46.113362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:46.128964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:46.151154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:46.151922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:46.152239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:46.157939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:46.162370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:46.238792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 863/1715] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:46.242252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:46.269558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfc4ca-6d11-4297-acf3-c25b010ea7fd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:46.293017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:46.296704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:46.298613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:46.298917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:46.300626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:46.305398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:46.353575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 864/1716] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:46.362256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:46.384078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 853/1717] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:46.412588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49ad9-fd2e-46af-a72e-f06d7153219c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:46.414667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:46.416405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:46.419879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71b1fe-18fd-416d-807b-7b1781094a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:46.420874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b1fe-18fd-416d-807b-7b1781094a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:46.421072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b1fe-18fd-416d-807b-7b1781094a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:46.421418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b1fe-18fd-416d-807b-7b1781094a94 admin admin] PATH_INFO: `/v3/projects/c5487a15333841ec97ccf23dd0ce5dc7/users/1fffa70db9834567907e468b62757149/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:46.454792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b1fe-18fd-416d-807b-7b1781094a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5487a15333841ec97ccf23dd0ce5dc7, user_id=1fffa70db9834567907e468b62757149, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:46.458091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b1fe-18fd-416d-807b-7b1781094a94 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:46.483559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 865/1718] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:46 2022] PUT /identity/v3/projects/c5487a15333841ec97ccf23dd0ce5dc7/users/1fffa70db9834567907e468b62757149/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:46.500152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a91c-44c1-4be5-86d0-d36f8293d0c5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:46.504346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a91c-44c1-4be5-86d0-d36f8293d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:46.504717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a91c-44c1-4be5-86d0-d36f8293d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:46.569655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c4868-1459-49d6-8a5c-bf51a4852cd3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:46.606212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1f77a91c-44c1-4be5-86d0-d36f8293d0c5 None None] MFA Rules not processed for user `1fffa70db9834567907e468b62757149`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:46.606370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1f77a91c-44c1-4be5-86d0-d36f8293d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:46.678496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbba37e-d57b-4934-8b05-9b2d31ae185a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:46.679284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba37e-d57b-4934-8b05-9b2d31ae185a service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:46.679569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba37e-d57b-4934-8b05-9b2d31ae185a service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:46.679889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba37e-d57b-4934-8b05-9b2d31ae185a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:46.794716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 866/1719] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:46.800952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77a91c-44c1-4be5-86d0-d36f8293d0c5 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:46.847555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbba37e-d57b-4934-8b05-9b2d31ae185a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:46.849339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbba37e-d57b-4934-8b05-9b2d31ae185a service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:46.858435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:46.867767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 854/1720] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:09:46.967342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77a91c-44c1-4be5-86d0-d36f8293d0c5 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:46.983991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:46.984542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:46.986649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:46.986943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:46.990057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:46.993007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:47.073462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f59b-b831-4f2a-8415-1d15d2545022 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:47.074408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f59b-b831-4f2a-8415-1d15d2545022 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:47.074915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f59b-b831-4f2a-8415-1d15d2545022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:47.135561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f651f59b-b831-4f2a-8415-1d15d2545022 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:47.143197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f651f59b-b831-4f2a-8415-1d15d2545022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:47.163899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 867/1721] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:46 2022] POST /identity/v3/projects => generated 377 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:47.171210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:47.210285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:47.358001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 855/1722] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:09:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:09:47.399876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f3673-0041-4f06-bcd4-d6d377d79e81 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:47.452741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d7c23-19b7-487c-b651-8bb8d1f2f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:47.453447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d7c23-19b7-487c-b651-8bb8d1f2f67f admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:47.458947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d7c23-19b7-487c-b651-8bb8d1f2f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:47.459305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d7c23-19b7-487c-b651-8bb8d1f2f67f admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:47.460079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d7c23-19b7-487c-b651-8bb8d1f2f67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:47.462503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d7c23-19b7-487c-b651-8bb8d1f2f67f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:47.495851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 868/1723] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:47 2022] POST /identity/v3/users => generated 295 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:47.499736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651f59b-b831-4f2a-8415-1d15d2545022 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:47.551851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3e19d-4222-4987-9e87-0a0d515e2cbf None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:47.552876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3e19d-4222-4987-9e87-0a0d515e2cbf None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:47.553174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3e19d-4222-4987-9e87-0a0d515e2cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:47.555185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651f59b-b831-4f2a-8415-1d15d2545022 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:47.579418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:47.582336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:47.582643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:47.582982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:47.584013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:47.589699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:47.639406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 856/1724] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:09:47.640122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-42e3e19d-4222-4987-9e87-0a0d515e2cbf None None] MFA Rules not processed for user `c35675c94f9a44c7943501d33abb0f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:47.641041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:47.644275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-42e3e19d-4222-4987-9e87-0a0d515e2cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:47.675745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b2c6-dd2a-405d-980e-263ce829d592 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:47.704360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:47.705311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:47.706472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:47.706757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] PATH_INFO: `/v3/projects/3d8e1a37fe95478687848ebdb4579cc9/users/de4f3a43a5a441eb857ac082bdde8171/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:47.769016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8e1a37fe95478687848ebdb4579cc9, user_id=de4f3a43a5a441eb857ac082bdde8171, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:47.776160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:47.808176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 857/1725] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:47 2022] PUT /identity/v3/projects/3d8e1a37fe95478687848ebdb4579cc9/users/de4f3a43a5a441eb857ac082bdde8171/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:47.810383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:47.813415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:47.851638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 869/1726] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:47.851638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3e19d-4222-4987-9e87-0a0d515e2cbf None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:47.874820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3e19d-4222-4987-9e87-0a0d515e2cbf None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:47.937030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f5d4-7314-4c4e-9a05-5f6aa9319cb4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:47.944618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:47.945977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:47.946327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:47.946677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.001865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:48.003059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.003346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.003735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] PATH_INFO: `/v3/users/0f386875d6e248e08e66d87b14945ac8` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.007610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f386875d6e248e08e66d87b14945ac8)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:48.009679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:48.068667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:48.085860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:48.089537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:48.089863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f386875d6e248e08e66d87b14945ac8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:48.114990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f386875d6e248e08e66d87b14945ac8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:48.116220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f386875d6e248e08e66d87b14945ac8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:48.117145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 858/1727] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:09:48.117332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f386875d6e248e08e66d87b14945ac8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:48.118025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:48.132320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fe03f-8e6f-4465-9177-a729e70d1ea5 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:48.133546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f386875d6e248e08e66d87b14945ac8'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:48.138592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17801e43-ac05-421c-81e4-fda381f5ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:48.140062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17801e43-ac05-421c-81e4-fda381f5ffde admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.140424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17801e43-ac05-421c-81e4-fda381f5ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.141211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17801e43-ac05-421c-81e4-fda381f5ffde admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.142036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17801e43-ac05-421c-81e4-fda381f5ffde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:48.144002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17801e43-ac05-421c-81e4-fda381f5ffde admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:48.151460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:48.164193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 859/1728] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:48.165952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a73bb-1a16-4bdb-9a50-716e2b49fa5b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.166252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a73bb-1a16-4bdb-9a50-716e2b49fa5b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.167058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a73bb-1a16-4bdb-9a50-716e2b49fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.168109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 870/1729] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:47 2022] DELETE /identity/v3/users/0f386875d6e248e08e66d87b14945ac8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:48.170846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:48.174919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:48.196127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-203a73bb-1a16-4bdb-9a50-716e2b49fa5b None None] MFA Rules not processed for user `c35675c94f9a44c7943501d33abb0f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:48.197849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-203a73bb-1a16-4bdb-9a50-716e2b49fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:48.308393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 860/1730] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:48.310765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.310765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.311166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.323467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca1cf9-0d5c-4f52-9243-a58622aa068e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:48.336263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:48.337492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:48.344668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546fd38-9e24-4b2d-8621-e81a56813e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:48.345607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fd38-9e24-4b2d-8621-e81a56813e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.345925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fd38-9e24-4b2d-8621-e81a56813e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.353513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fd38-9e24-4b2d-8621-e81a56813e05 admin admin] PATH_INFO: `/v3/projects/3d8e1a37fe95478687848ebdb4579cc9/users/de4f3a43a5a441eb857ac082bdde8171/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.359948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546fd38-9e24-4b2d-8621-e81a56813e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8e1a37fe95478687848ebdb4579cc9, user_id=de4f3a43a5a441eb857ac082bdde8171, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:48.361830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 861/1731] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:48.363309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:48.368789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546fd38-9e24-4b2d-8621-e81a56813e05 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:48.370367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:48.395633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 871/1732] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:48 2022] PUT /identity/v3/projects/3d8e1a37fe95478687848ebdb4579cc9/users/de4f3a43a5a441eb857ac082bdde8171/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:48.408364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86458345-c7b6-4859-9db9-88777370c72c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.423008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86458345-c7b6-4859-9db9-88777370c72c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.423287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86458345-c7b6-4859-9db9-88777370c72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.567310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-86458345-c7b6-4859-9db9-88777370c72c None None] MFA Rules not processed for user `de4f3a43a5a441eb857ac082bdde8171`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:48.571460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-86458345-c7b6-4859-9db9-88777370c72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:48.619740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a98cbf-cf6b-4b9e-a553-4d731b78b7ec None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:48.850406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 872/1733] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:48.859834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.859834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.859834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.884770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:48.888108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:48.894339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:48.895080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:48.901103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:48.999872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] MFA Rules not processed for user `4fc58f7ca26240ef9c1e458dd5832a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:49.006408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:49.057124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:49.082834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:49.167336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:49.182570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:49.249664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 862/1734] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 887 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:49.252227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:49.264247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:49.360443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 873/1735] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:49.371305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:49.379243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:49.463856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace11c8-6f6d-4bb2-b80a-e304a47e93c1 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:49.480241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5786-09d7-4706-8013-83e4f5ca3db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:49.481055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5786-09d7-4706-8013-83e4f5ca3db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:49.484604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5786-09d7-4706-8013-83e4f5ca3db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:49.485443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5786-09d7-4706-8013-83e4f5ca3db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:49.754126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3b035-67a6-460e-a732-b98b779c32aa None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:49.776133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:49.777512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:49.777855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:49.780886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:49.789555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:49.827560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5786-09d7-4706-8013-83e4f5ca3db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:49.831431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5786-09d7-4706-8013-83e4f5ca3db8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:49.857625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 863/1736] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:49.861941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c3af-ad86-4e54-be36-78b8f361e3e1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:49.862567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c3af-ad86-4e54-be36-78b8f361e3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:49.863059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c3af-ad86-4e54-be36-78b8f361e3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:49.908583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d4f3c3af-ad86-4e54-be36-78b8f361e3e1 None None] MFA Rules not processed for user `a5b5399fad924cabaf1d414bbca2c191`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:49.911433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d4f3c3af-ad86-4e54-be36-78b8f361e3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:49.941867 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 864/1737] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Jul 4 10:09:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:49.944949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:49.945360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:49.947416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:50.019123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] MFA Rules not processed for user `4fc58f7ca26240ef9c1e458dd5832a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:50.020943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:50.040611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 865/1738] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:50.043699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:50.054132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:50.065164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:50.069831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:50.079116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3fd69-1849-427f-8ec6-75bfc7bcf32f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:50.096443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a217384-91c7-4616-940c-c7f085b158ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:50.097539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217384-91c7-4616-940c-c7f085b158ba service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:50.098058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217384-91c7-4616-940c-c7f085b158ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:50.098569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217384-91c7-4616-940c-c7f085b158ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:50.110617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 874/1739] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:50.119669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a217384-91c7-4616-940c-c7f085b158ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:50.122398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a217384-91c7-4616-940c-c7f085b158ba service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:50.133903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 866/1740] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:50.431042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:50.432730 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:50.514876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0094a-2b09-498e-94fd-3c8d258bb399 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:50.524080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce60cc3-823d-4f35-aa2d-cc17f139ad05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:50.525635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce60cc3-823d-4f35-aa2d-cc17f139ad05 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:50.526492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce60cc3-823d-4f35-aa2d-cc17f139ad05 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:50.526932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce60cc3-823d-4f35-aa2d-cc17f139ad05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:50.541751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce60cc3-823d-4f35-aa2d-cc17f139ad05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:50.568009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce60cc3-823d-4f35-aa2d-cc17f139ad05 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:50.601527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 875/1741] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:51.136030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a9ba4-4024-468a-aa5e-461f516e819a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:51.136030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a9ba4-4024-468a-aa5e-461f516e819a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:51.136586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a9ba4-4024-468a-aa5e-461f516e819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:51.193611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-402a9ba4-4024-468a-aa5e-461f516e819a None None] MFA Rules not processed for user `0c3d791666e742e4915d4f52d8dbe03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:51.194883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-402a9ba4-4024-468a-aa5e-461f516e819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:51.413212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 867/1742] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:51.964809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d36f4-6bb7-466b-9826-3abc7f4654f8 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:51.965969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d36f4-6bb7-466b-9826-3abc7f4654f8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:51.965969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d36f4-6bb7-466b-9826-3abc7f4654f8 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:51.967765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 876/1743] 10.222.0.78 () {54 vars in 912 bytes} [Mon Jul 4 10:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 10:09:51.975748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0ad9-ec27-4ad7-8540-138428494aed None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:51.976062 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0ad9-ec27-4ad7-8540-138428494aed None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:51.976316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0ad9-ec27-4ad7-8540-138428494aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:51.984243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:52.022244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a14d0ad9-ec27-4ad7-8540-138428494aed None None] MFA Rules not processed for user `a5b5399fad924cabaf1d414bbca2c191`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:52.023491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a14d0ad9-ec27-4ad7-8540-138428494aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:52.050704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d36f4-6bb7-466b-9826-3abc7f4654f8 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:52.053672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 868/1744] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:09:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:52.058544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a54d36f4-6bb7-466b-9826-3abc7f4654f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:52.070651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0ad9-ec27-4ad7-8540-138428494aed None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:52.084591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0ad9-ec27-4ad7-8540-138428494aed None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:52.096926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925357-9828-4302-a993-c42243810beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:52.105179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d36f4-6bb7-466b-9826-3abc7f4654f8 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:52.110183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925357-9828-4302-a993-c42243810beb service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:52.110605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925357-9828-4302-a993-c42243810beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:52.112805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925357-9828-4302-a993-c42243810beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:52.113932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:52.115021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:52.116875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:52.117339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] PATH_INFO: `/v3/projects/93089c1e05414fd7a17c5c3e95494a43` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:52.120259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93089c1e05414fd7a17c5c3e95494a43)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:52.122908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:52.171342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925357-9828-4302-a993-c42243810beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:52.179311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925357-9828-4302-a993-c42243810beb service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:52.207334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 869/1745] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:09:52.354960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925357-9828-4302-a993-c42243810beb service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:52.357233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93089c1e05414fd7a17c5c3e95494a43', 'request_id': 'req-f7528e06-ff80-4cb0-b178-c407ba6f5957'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:52.373902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:52.375799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925357-9828-4302-a993-c42243810beb service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:52.397517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93089c1e05414fd7a17c5c3e95494a43', 'request_id': 'req-f7528e06-ff80-4cb0-b178-c407ba6f5957'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:52.431273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93089c1e05414fd7a17c5c3e95494a43', 'request_id': 'req-f7528e06-ff80-4cb0-b178-c407ba6f5957'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:52.490727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] The token cache is being invalidate because project 93089c1e05414fd7a17c5c3e95494a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:09:52.495747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:52.515135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:52.527866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 877/1746] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:09:52 2022] DELETE /identity/v3/projects/93089c1e05414fd7a17c5c3e95494a43 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:52.537357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:52.541281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:52.626739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090ebdb-efe6-451c-ae55-4a9264b3280a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:52.629322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ebdb-efe6-451c-ae55-4a9264b3280a service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:52.640036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ebdb-efe6-451c-ae55-4a9264b3280a service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:52.640506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ebdb-efe6-451c-ae55-4a9264b3280a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:52.646909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6090ebdb-efe6-451c-ae55-4a9264b3280a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:52.922703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090ebdb-efe6-451c-ae55-4a9264b3280a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:52.924372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090ebdb-efe6-451c-ae55-4a9264b3280a service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:52.926794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7528e06-ff80-4cb0-b178-c407ba6f5957 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:52.954488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:52.959819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 870/1747] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:09:52.960359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:52.960838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:52.962998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] PATH_INFO: `/v3/users/8950de12b04a4d13946c18f99f2755ea` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:52.966532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8950de12b04a4d13946c18f99f2755ea)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:52.974271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:53.161782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8950de12b04a4d13946c18f99f2755ea'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:53.186755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8950de12b04a4d13946c18f99f2755ea'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:53.187676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8950de12b04a4d13946c18f99f2755ea'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:53.191685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8950de12b04a4d13946c18f99f2755ea'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:53.204750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-fdad0265-b3dc-4c42-a57f-2add7b4abe61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8950de12b04a4d13946c18f99f2755ea'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:53.276389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 878/1748] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:52 2022] DELETE /identity/v3/users/8950de12b04a4d13946c18f99f2755ea => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:53.848732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20db5-18ae-4b18-8630-bfc44e56bca5 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:53.849679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20db5-18ae-4b18-8630-bfc44e56bca5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:53.849679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20db5-18ae-4b18-8630-bfc44e56bca5 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:53.850895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 871/1749] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:09:53 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:09:53.887431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458398-ebf8-49e0-ae9d-c41d2ce7ef7a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:53.888506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458398-ebf8-49e0-ae9d-c41d2ce7ef7a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:53.889286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458398-ebf8-49e0-ae9d-c41d2ce7ef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:53.950844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-75458398-ebf8-49e0-ae9d-c41d2ce7ef7a None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:53.957926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-75458398-ebf8-49e0-ae9d-c41d2ce7ef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:53.994742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:53.995712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:53.996334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:54.105976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] MFA Rules not processed for user `c35675c94f9a44c7943501d33abb0f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:54.112305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:54.328668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:54.364410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 872/1750] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:09:54.401282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 879/1751] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:54.452195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:54.453658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:54.776323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:54.978616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde08cd-3824-4f25-9ea2-648683baf425 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:55.013091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:55.025716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:55.028013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:55.028329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] PATH_INFO: `/v3/projects/5b0f111e86d34bd59b5c0c93269f05fe` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:55.039637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0f111e86d34bd59b5c0c93269f05fe)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:55.045665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:55.248996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0f111e86d34bd59b5c0c93269f05fe', 'request_id': 'req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:55.277170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0f111e86d34bd59b5c0c93269f05fe', 'request_id': 'req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:55.313943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0f111e86d34bd59b5c0c93269f05fe', 'request_id': 'req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:55.391960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] The token cache is being invalidate because project 5b0f111e86d34bd59b5c0c93269f05fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:09:55.392217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:55.398092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-d6cdb7ed-2f13-4ba1-967c-5cb3e31febc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:55.410195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 873/1752] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:09:54 2022] DELETE /identity/v3/projects/5b0f111e86d34bd59b5c0c93269f05fe => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:09:55.416794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503033-4f2a-4726-87ea-220136eb4592 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:55.417392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503033-4f2a-4726-87ea-220136eb4592 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:55.417392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503033-4f2a-4726-87ea-220136eb4592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:55.491787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-11503033-4f2a-4726-87ea-220136eb4592 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:55.503931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-11503033-4f2a-4726-87ea-220136eb4592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:55.756619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 880/1753] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:55.757574 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2f54-3f2f-4385-8826-4e1e6660299d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:55.757873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2f54-3f2f-4385-8826-4e1e6660299d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:55.758185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2f54-3f2f-4385-8826-4e1e6660299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:55.801212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bfef2f54-3f2f-4385-8826-4e1e6660299d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:55.802471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bfef2f54-3f2f-4385-8826-4e1e6660299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:55.830818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 874/1754] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:55.835379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11503033-4f2a-4726-87ea-220136eb4592 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:55.854090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11503033-4f2a-4726-87ea-220136eb4592 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:55.883814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:55.884447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:55.884733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:55.885277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:55.885759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:09:55.886074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:55.909412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:55.961954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef2f54-3f2f-4385-8826-4e1e6660299d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:55.962900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 881/1755] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:09:55.983371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef2f54-3f2f-4385-8826-4e1e6660299d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:56.005593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:56.006666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:56.007105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:56.007722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:56.017304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:56.020050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:56.106269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 875/1756] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:55 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:56.109794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:56.126195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cef14-2251-48fc-a20a-524d9c6c994f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:56.316687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:56.319726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:56.320023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:56.320310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:56.325739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:56.327797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:56.368533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:56.373222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 882/1757] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:56 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:56.373388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:56.374951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:56.395062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2537d53-beec-4a30-8c71-205c13b33423 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:56.412856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:56.414103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:56.414604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:56.415142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:56.417072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:56.423147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:56.440854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 883/1758] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:09:56.445294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:56.462439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bdf7d-f722-4d60-8b16-a3413b38fbd1 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:56.475036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:56.477729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:56.478422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:56.479516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:56.480507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:56.482315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:56.500967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 884/1759] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:56.502120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:56.525336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df3203-0019-4e3a-8a4b-4197b6d795df admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:56.542073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5be83c-90db-4ffc-ad7a-b1b33649ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:56.543005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be83c-90db-4ffc-ad7a-b1b33649ce36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:56.543273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be83c-90db-4ffc-ad7a-b1b33649ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:56.543559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be83c-90db-4ffc-ad7a-b1b33649ce36 admin admin] PATH_INFO: `/v3/projects/65067d69a8244170a19d8394f4545b7e/users/9859cd3f212445049fb4b744af8d515c/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:56.606810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5be83c-90db-4ffc-ad7a-b1b33649ce36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65067d69a8244170a19d8394f4545b7e, user_id=9859cd3f212445049fb4b744af8d515c, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:56.610441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5be83c-90db-4ffc-ad7a-b1b33649ce36 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:56.633964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 885/1760] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:56 2022] PUT /identity/v3/projects/65067d69a8244170a19d8394f4545b7e/users/9859cd3f212445049fb4b744af8d515c/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:56.636457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cda3b4-88c7-45ed-aac7-eefaa4d2bc15 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:56.644927 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911d7b-749e-4f71-b647-15055823e7c2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:56.646251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911d7b-749e-4f71-b647-15055823e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:56.646789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911d7b-749e-4f71-b647-15055823e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:56.763313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:56.767180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3a911d7b-749e-4f71-b647-15055823e7c2 None None] MFA Rules not processed for user `9859cd3f212445049fb4b744af8d515c`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:56.769121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3a911d7b-749e-4f71-b647-15055823e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:56.817022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:56.869861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:56.870719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:56.871177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:56.871548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:56.876875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:56.896481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:56.902428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:57.015265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 876/1761] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:57.045337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 886/1762] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:57.049990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:57.303263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90987169-2294-4fda-9b89-6c4690c11683 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:57.324109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:57.325501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:57.325799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:57.326084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:57.332540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:57.340105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:57.421792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 877/1763] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:09:57 2022] POST /identity/v3/projects => generated 389 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:09:57.423970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a911d7b-749e-4f71-b647-15055823e7c2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:57.453027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a911d7b-749e-4f71-b647-15055823e7c2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:57.737372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:57.740347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:57.740640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:57.741160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:57.752113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:57.754185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:57.819882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 887/1764] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:09:57 2022] POST /identity/v3/users => generated 301 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:09:57.827198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:57.866565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74405a-abc3-464d-bc3f-754de4102d96 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:57.883505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:57.889698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:57.890147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:57.890572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:57.891499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:57.899911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:57.931033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 878/1765] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:57.934995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:57.958325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ff588-97e4-40b1-998c-df5f403181ec admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:57.985530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:57.986766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:57.986766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:57.986994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] PATH_INFO: `/v3/projects/2b37c20dba9b48e5b1b530decbc61829/users/6c0fcd980aff4c8db8b895575968b80a/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:58.036345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b37c20dba9b48e5b1b530decbc61829, user_id=6c0fcd980aff4c8db8b895575968b80a, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:58.039172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:58.137394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 888/1766] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:57 2022] PUT /identity/v3/projects/2b37c20dba9b48e5b1b530decbc61829/users/6c0fcd980aff4c8db8b895575968b80a/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:58.139666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:58.164193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11265b4-6602-4111-a00b-24941407cb21 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:58.301989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9af05-21eb-42c4-b4f1-d75b207b7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:58.302895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9af05-21eb-42c4-b4f1-d75b207b7c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:58.303426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9af05-21eb-42c4-b4f1-d75b207b7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:58.304475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9af05-21eb-42c4-b4f1-d75b207b7c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:58.305990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9af05-21eb-42c4-b4f1-d75b207b7c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:58.313432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9af05-21eb-42c4-b4f1-d75b207b7c32 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:58.328518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 879/1767] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:09:58.332802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:58.349220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0952-2cd7-4afd-b5c9-58b1ccac99d6 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:58.356810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:58.358408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:58.367862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:58.368814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] PATH_INFO: `/v3/projects/2b37c20dba9b48e5b1b530decbc61829/users/6c0fcd980aff4c8db8b895575968b80a/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:58.372589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b37c20dba9b48e5b1b530decbc61829, user_id=6c0fcd980aff4c8db8b895575968b80a, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:58.377175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:58.394295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 889/1768] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:09:58 2022] PUT /identity/v3/projects/2b37c20dba9b48e5b1b530decbc61829/users/6c0fcd980aff4c8db8b895575968b80a/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:58.407052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:58.407344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:58.407842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:58.458591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] MFA Rules not processed for user `6c0fcd980aff4c8db8b895575968b80a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:58.460228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:58.554958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:58.758848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 880/1769] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:09:58.951338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:58.962360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:59.010220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:59.013207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:59.231355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fe7d5-75db-4ad4-89ee-61e059838edf admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:59.251321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8e32-963e-4e13-bdbe-8113e87fd68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:59.254549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8e32-963e-4e13-bdbe-8113e87fd68b service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:59.255834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8e32-963e-4e13-bdbe-8113e87fd68b service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:59.256132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8e32-963e-4e13-bdbe-8113e87fd68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:59.298457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8e32-963e-4e13-bdbe-8113e87fd68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:59.304050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8e32-963e-4e13-bdbe-8113e87fd68b service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:59.313397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89c1a-fcf7-4466-88a6-027d0e7f172d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:09:59.327527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:09:59.329194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:59.331792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:59.332090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] PATH_INFO: `/v3/users/1fffa70db9834567907e468b62757149` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:59.336037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fffa70db9834567907e468b62757149)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:09:59.343557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:09:59.358547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 890/1770] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:09:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:09:59.627918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fffa70db9834567907e468b62757149'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:59.632099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fffa70db9834567907e468b62757149'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:59.666330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fffa70db9834567907e468b62757149'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:59.680286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fffa70db9834567907e468b62757149'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:59.681457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fffa70db9834567907e468b62757149'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:09:59.762921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 881/1771] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:59 2022] DELETE /identity/v3/users/1fffa70db9834567907e468b62757149 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:09:59.767326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:09:59.767824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:09:59.768317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:09:59.805513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:09:59.839647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:09:59.845235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:59.845370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:09:59.847009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:09:59.992736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:00.098940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44342b4b-71eb-40f4-b295-ddeac36896b8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:00.101181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 891/1772] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:00.108421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:00.109331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:00.109619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:00.110049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] PATH_INFO: `/v3/users/9859cd3f212445049fb4b744af8d515c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:00.111326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9859cd3f212445049fb4b744af8d515c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:00.113506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:00.169185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:00.177498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:00.251976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9859cd3f212445049fb4b744af8d515c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:00.255210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9859cd3f212445049fb4b744af8d515c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:00.293466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9859cd3f212445049fb4b744af8d515c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:00.326461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9859cd3f212445049fb4b744af8d515c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:00.336110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-36b9dc49-656c-44b9-8992-8fe858867be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9859cd3f212445049fb4b744af8d515c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:00.389109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 882/1773] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:09:59 2022] DELETE /identity/v3/users/9859cd3f212445049fb4b744af8d515c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:00.394284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:00.394581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:00.394872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:00.468407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:00.469369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922515a5-ea07-4216-8a4c-8b1c6c6fa1ae None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:00.479129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:00.715523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:00.716495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:00.718254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:00.718794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:00.723682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:00.743464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 883/1774] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:00.757823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:00.760797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:00.776751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 892/1775] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:01.154643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:01.161742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:01.196559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d596d32-24d9-43e6-a4e3-8c8db47f602a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:01.220561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:01.224639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:01.225126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:01.226354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:01.277854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:01.282888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:01.320509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 884/1776] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:02.643426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:02.646007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:02.667312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224692-feb5-4a35-b1a2-8f34e6539123 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:02.683633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:02.683633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:02.683633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:02.683633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] PATH_INFO: `/v3/projects/c5487a15333841ec97ccf23dd0ce5dc7` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:02.685505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5487a15333841ec97ccf23dd0ce5dc7)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:02.688554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:02.892147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5487a15333841ec97ccf23dd0ce5dc7', 'request_id': 'req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:02.926997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5487a15333841ec97ccf23dd0ce5dc7', 'request_id': 'req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:02.952876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5487a15333841ec97ccf23dd0ce5dc7', 'request_id': 'req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:02.975113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:03.011065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] The token cache is being invalidate because project c5487a15333841ec97ccf23dd0ce5dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:03.012445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:03.014605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:03.020542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 893/1777] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:02 2022] DELETE /identity/v3/projects/c5487a15333841ec97ccf23dd0ce5dc7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:03.024188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:03.040741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd167be4-fc0a-4759-a719-070c30a9a11e service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:03.122940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:03.189050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:03.194178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:03.195239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:03.196448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] PATH_INFO: `/v3/users/de4f3a43a5a441eb857ac082bdde8171` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:03.202002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4f3a43a5a441eb857ac082bdde8171)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:03.209387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:03.294577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4f3a43a5a441eb857ac082bdde8171'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:03.296329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4f3a43a5a441eb857ac082bdde8171'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:03.317362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4f3a43a5a441eb857ac082bdde8171'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:03.335953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4f3a43a5a441eb857ac082bdde8171'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:03.337152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4f3a43a5a441eb857ac082bdde8171'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:03.365236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 885/1778] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:03 2022] DELETE /identity/v3/users/de4f3a43a5a441eb857ac082bdde8171 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:03.855881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:03.861603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:03.886892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d2b3-ea92-4656-b644-c1dddc16c66c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:03.964919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:03.965939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:03.966346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:03.966633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] PATH_INFO: `/v3/projects/65067d69a8244170a19d8394f4545b7e` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:03.968029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] RBAC: Authorizing `identity:delete_project(project_id=65067d69a8244170a19d8394f4545b7e)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:03.970248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:04.063521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65067d69a8244170a19d8394f4545b7e', 'request_id': 'req-a5649d1a-fe33-4bcf-9069-4b36ccd180da'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.078261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65067d69a8244170a19d8394f4545b7e', 'request_id': 'req-a5649d1a-fe33-4bcf-9069-4b36ccd180da'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.087965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65067d69a8244170a19d8394f4545b7e', 'request_id': 'req-a5649d1a-fe33-4bcf-9069-4b36ccd180da'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.116115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] The token cache is being invalidate because project 65067d69a8244170a19d8394f4545b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:04.116476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.117511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.120311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 894/1779] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:03 2022] DELETE /identity/v3/projects/65067d69a8244170a19d8394f4545b7e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:04.124689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:04.127081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:04.141694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ea14-476b-4778-be0f-4429e912d2d8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:04.223416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:04.224731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.225235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.225995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] PATH_INFO: `/v3/users/6c0fcd980aff4c8db8b895575968b80a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.228477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0fcd980aff4c8db8b895575968b80a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:04.231684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:04.253379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:04.255513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:04.280629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649d1a-fe33-4bcf-9069-4b36ccd180da admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:04.286535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:04.288121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.288425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.288706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] PATH_INFO: `/v3/projects/3d8e1a37fe95478687848ebdb4579cc9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.290979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8e1a37fe95478687848ebdb4579cc9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:04.298658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:04.339232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0fcd980aff4c8db8b895575968b80a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.341007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0fcd980aff4c8db8b895575968b80a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.353357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0fcd980aff4c8db8b895575968b80a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.373192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0fcd980aff4c8db8b895575968b80a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.375608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b8bf37a2-b357-4382-8030-ec21b3ec5ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0fcd980aff4c8db8b895575968b80a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.379767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:04.394648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8e1a37fe95478687848ebdb4579cc9', 'request_id': 'req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.405682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8e1a37fe95478687848ebdb4579cc9', 'request_id': 'req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.414547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8e1a37fe95478687848ebdb4579cc9', 'request_id': 'req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.426197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 886/1780] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:04 2022] DELETE /identity/v3/users/6c0fcd980aff4c8db8b895575968b80a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:04.440974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] The token cache is being invalidate because project 3d8e1a37fe95478687848ebdb4579cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:04.441335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.442168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.449685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2592fca-eeb8-4d7c-b066-167140ff2085 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.450130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2592fca-eeb8-4d7c-b066-167140ff2085 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.450420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2592fca-eeb8-4d7c-b066-167140ff2085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.451950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 895/1781] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:04 2022] DELETE /identity/v3/projects/3d8e1a37fe95478687848ebdb4579cc9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:04.472043 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e2592fca-eeb8-4d7c-b066-167140ff2085 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:04.473297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e2592fca-eeb8-4d7c-b066-167140ff2085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:04.545893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:04.551758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:04.559769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:04.612242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 887/1782] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:04.619263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5184f9-3769-4dec-a43f-118d60d24fb9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.619558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5184f9-3769-4dec-a43f-118d60d24fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.619862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5184f9-3769-4dec-a43f-118d60d24fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.661555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-da5184f9-3769-4dec-a43f-118d60d24fb9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:04.663122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-da5184f9-3769-4dec-a43f-118d60d24fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:04.676837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 888/1783] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:04.681280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5184f9-3769-4dec-a43f-118d60d24fb9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:04.695359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5184f9-3769-4dec-a43f-118d60d24fb9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:04.713909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd0e58-50bd-4fb9-8af6-1a4df641f8fa admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:04.720093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:04.722648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.723928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.724310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.724508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:04.725384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:04.725497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.725669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.725944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] PATH_INFO: `/v3/users/8625f2bd4603450c8e5d504702db237a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.726160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:04.727168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8625f2bd4603450c8e5d504702db237a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:04.728245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:04.729131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:04.748130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 889/1784] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:04.754566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:04.766594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855aa5-1dcf-4f5e-8755-d822250140d0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:04.771431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:04.772153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.772445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.772731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.773588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:04.775680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:04.817002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 890/1785] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:04 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:04.822020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:04.824719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8625f2bd4603450c8e5d504702db237a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.834862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8625f2bd4603450c8e5d504702db237a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.836031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8625f2bd4603450c8e5d504702db237a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.836980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8625f2bd4603450c8e5d504702db237a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.853666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-3686178d-960d-4376-a01b-23cdfaf4207c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8625f2bd4603450c8e5d504702db237a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:04.893994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 896/1786] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:04 2022] DELETE /identity/v3/users/8625f2bd4603450c8e5d504702db237a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:04.899477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:04.901784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:04.902929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:04.915888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9027c-a723-41e7-986d-0b57c1c34add admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:04.937786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:04.939663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.032926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:05.050923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.051678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.051970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.052254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.052960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.055299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.057467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 897/1787] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:05.059142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.060567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.078129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79740-7ea1-46cb-a992-339f9f07203e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.085894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 891/1788] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:04 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:05.087337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.091099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.093763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.094772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.095124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.095467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] PATH_INFO: `/v3/projects/2b37c20dba9b48e5b1b530decbc61829` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.097689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b37c20dba9b48e5b1b530decbc61829)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.102309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.143937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:05.168543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d836bb2-3c2d-4030-9b8a-38303a717d13 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.182191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b37c20dba9b48e5b1b530decbc61829', 'request_id': 'req-82ef87e1-4fff-478d-ad93-f587cb1dc562'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:05.189928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b37c20dba9b48e5b1b530decbc61829', 'request_id': 'req-82ef87e1-4fff-478d-ad93-f587cb1dc562'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:05.195629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b37c20dba9b48e5b1b530decbc61829', 'request_id': 'req-82ef87e1-4fff-478d-ad93-f587cb1dc562'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:05.208136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] The token cache is being invalidate because project 2b37c20dba9b48e5b1b530decbc61829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:05.208509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:05.209243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:05.211174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 898/1789] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:05 2022] DELETE /identity/v3/projects/2b37c20dba9b48e5b1b530decbc61829 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:05.212327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.213636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.219504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.220278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.220594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.220915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.222729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.282868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef87e1-4fff-478d-ad93-f587cb1dc562 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.287803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76274e9-c3e6-46e6-a740-c3b62ce473b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.288501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76274e9-c3e6-46e6-a740-c3b62ce473b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.288809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76274e9-c3e6-46e6-a740-c3b62ce473b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.289087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76274e9-c3e6-46e6-a740-c3b62ce473b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.289823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76274e9-c3e6-46e6-a740-c3b62ce473b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.291219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.291538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76274e9-c3e6-46e6-a740-c3b62ce473b8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.293322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.302669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 899/1790] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:05.303799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 892/1791] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:05.304248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd537c1-6052-44fe-b03b-002509bbc3a2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.304538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd537c1-6052-44fe-b03b-002509bbc3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.305857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd537c1-6052-44fe-b03b-002509bbc3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.307184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.322402 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1d20-48e4-453e-b35e-07f2e7c160f7 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.337364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-dfd537c1-6052-44fe-b03b-002509bbc3a2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:05.338599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-dfd537c1-6052-44fe-b03b-002509bbc3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.341017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.342080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.342369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.343226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.345663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.348696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.349609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 900/1792] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:05.358974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a86e-6160-47d7-b1f3-e9471b89a502 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.359268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a86e-6160-47d7-b1f3-e9471b89a502 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.359553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a86e-6160-47d7-b1f3-e9471b89a502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.371745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 893/1793] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:05.374096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.380708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9f12a86e-6160-47d7-b1f3-e9471b89a502 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:05.382078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9f12a86e-6160-47d7-b1f3-e9471b89a502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.390864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b12b-6af5-489a-9e6c-a0166c66ae10 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.391042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 901/1794] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:05.394920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a86e-6160-47d7-b1f3-e9471b89a502 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.402144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dde3e-1970-43dd-8493-65b889de0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.403685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dde3e-1970-43dd-8493-65b889de0c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.404542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dde3e-1970-43dd-8493-65b889de0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.405144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dde3e-1970-43dd-8493-65b889de0c82 admin admin] PATH_INFO: `/v3/projects/7bbf32d2e1c34c28b7bcc6b1d819efd3/users/101624f8962443f393c8c171fe4f3b8b/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.405594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a86e-6160-47d7-b1f3-e9471b89a502 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.412557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.413240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.413523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.413856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.414598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:05.414904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.416627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.425995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dde3e-1970-43dd-8493-65b889de0c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbf32d2e1c34c28b7bcc6b1d819efd3, user_id=101624f8962443f393c8c171fe4f3b8b, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.428782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dde3e-1970-43dd-8493-65b889de0c82 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.436207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 902/1795] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:10:05.437379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.448693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 894/1796] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:05 2022] PUT /identity/v3/projects/7bbf32d2e1c34c28b7bcc6b1d819efd3/users/101624f8962443f393c8c171fe4f3b8b/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:05.449287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2683d-0823-4317-875a-6cf0d1410783 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.461158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1304e-04cc-4c31-b25a-81be57f3cb0b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.461457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1304e-04cc-4c31-b25a-81be57f3cb0b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.461727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1304e-04cc-4c31-b25a-81be57f3cb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.483443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:05.500468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d6d1304e-04cc-4c31-b25a-81be57f3cb0b None None] MFA Rules not processed for user `101624f8962443f393c8c171fe4f3b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:05.502337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d6d1304e-04cc-4c31-b25a-81be57f3cb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.521057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.522758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.523316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.523834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.525034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.530453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.561038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:05.578974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 903/1797] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:05 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:05.583168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.599420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 895/1798] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:05.604142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1304e-04cc-4c31-b25a-81be57f3cb0b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.617449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1304e-04cc-4c31-b25a-81be57f3cb0b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.658147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d39a2-2ec2-40ff-8441-e7a311b8b6bf admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.662975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.663688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.663973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.664252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.664955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.666895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.682313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.683351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.683831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.684117 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.684832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.687008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.703776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 904/1799] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:05 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:05.706798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.736899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32688b-bfa4-46ac-a589-8c54c1549fba admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.742429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 896/1800] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:05 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:05.742595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.743361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.743740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.744476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.745354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.746472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.747979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.769359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 905/1801] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:05.770388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.790297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a662-b827-4d5a-9692-ebd567807268 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.888719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.889539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.889830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.890112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.890851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.893325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.895296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be53d-1f13-4597-9bf1-47e57b77dd53 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.912692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 906/1802] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:05.919187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:05.920057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:05.920300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:05.920655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:05.922038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:05.924500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:05.927548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:05.931539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:05.991960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a43b-20d5-405c-b4c8-5e1d9fb9b105 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:05.999819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 897/1803] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:05 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:06.005658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.023766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.028781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.029092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.029381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] PATH_INFO: `/v3/projects/51480b1c51104c398a37e7e757a62cd8` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.036539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=51480b1c51104c398a37e7e757a62cd8)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.040809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.052789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4203e-bc72-4b9d-88cc-d4cd40c61e27 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.068604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.071708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.073533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.074589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] PATH_INFO: `/v3/projects/da84d0c8536349ef8cc40fabb764d3c6/users/c67ca8b9f8d04c17bef9dc39c9c685e6/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.100850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:06.112185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da84d0c8536349ef8cc40fabb764d3c6, user_id=c67ca8b9f8d04c17bef9dc39c9c685e6, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.116865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.128606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51480b1c51104c398a37e7e757a62cd8', 'request_id': 'req-5797963e-7f97-458a-9f56-7e5ef5329dac'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:06.144794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 898/1804] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:06 2022] PUT /identity/v3/projects/da84d0c8536349ef8cc40fabb764d3c6/users/c67ca8b9f8d04c17bef9dc39c9c685e6/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:06.144979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51480b1c51104c398a37e7e757a62cd8', 'request_id': 'req-5797963e-7f97-458a-9f56-7e5ef5329dac'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:06.146194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.177922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51480b1c51104c398a37e7e757a62cd8', 'request_id': 'req-5797963e-7f97-458a-9f56-7e5ef5329dac'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:06.202405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:06.207891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] The token cache is being invalidate because project 51480b1c51104c398a37e7e757a62cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:06.208178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:06.210440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5797963e-7f97-458a-9f56-7e5ef5329dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:06.213881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 907/1805] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:05 2022] DELETE /identity/v3/projects/51480b1c51104c398a37e7e757a62cd8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:06.216063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992faa03-90f1-4341-843c-2ed43118088e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.219914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992faa03-90f1-4341-843c-2ed43118088e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.220520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992faa03-90f1-4341-843c-2ed43118088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.322752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-992faa03-90f1-4341-843c-2ed43118088e None None] MFA Rules not processed for user `c67ca8b9f8d04c17bef9dc39c9c685e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:06.325327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-992faa03-90f1-4341-843c-2ed43118088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:06.348180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8344e1-8f17-4bec-9f7b-ce7540474b4b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.356588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd763b3-f601-48d0-bb95-51e187638ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.358024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd763b3-f601-48d0-bb95-51e187638ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.358556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd763b3-f601-48d0-bb95-51e187638ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.359025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd763b3-f601-48d0-bb95-51e187638ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.360524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd763b3-f601-48d0-bb95-51e187638ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.372494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd763b3-f601-48d0-bb95-51e187638ef8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.406586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 899/1806] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:06.409543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.410069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.410544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.434501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:06.437060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:06.446747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 900/1807] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:06.447969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.450061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:06.468214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7586005-dd66-48d1-8a14-c87720caf0bd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.475528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.476580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.477975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.477975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.479456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.482125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.489962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 908/1808] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:06.493215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6231a-6b30-4f31-87ee-1b80080db4db None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.493739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6231a-6b30-4f31-87ee-1b80080db4db None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.494198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6231a-6b30-4f31-87ee-1b80080db4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.506995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 901/1809] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:06.517837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.524711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:06.540928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-33d6231a-6b30-4f31-87ee-1b80080db4db None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:06.542318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-33d6231a-6b30-4f31-87ee-1b80080db4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:06.548125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3bea3-2743-4a95-b498-a72a0ed92928 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.555288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 909/1810] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:06.556431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6231a-6b30-4f31-87ee-1b80080db4db None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.567284 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6231a-6b30-4f31-87ee-1b80080db4db None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.573291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.574885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.574885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.575423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] PATH_INFO: `/v3/projects/48d658f5552f4db78b1dcaedf2589a11/users/b311c94bb69d4189b6ea3d46a666fd81/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.583500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce58abe-652e-43d5-bf92-23782d5a6529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.584737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58abe-652e-43d5-bf92-23782d5a6529 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.585161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58abe-652e-43d5-bf92-23782d5a6529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.585446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58abe-652e-43d5-bf92-23782d5a6529 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.586175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce58abe-652e-43d5-bf92-23782d5a6529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.594765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce58abe-652e-43d5-bf92-23782d5a6529 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.597128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d658f5552f4db78b1dcaedf2589a11, user_id=b311c94bb69d4189b6ea3d46a666fd81, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.599868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.633649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 910/1811] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:06 2022] PUT /identity/v3/projects/48d658f5552f4db78b1dcaedf2589a11/users/b311c94bb69d4189b6ea3d46a666fd81/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:06.633649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.709777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 902/1812] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:06.713256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2256f2-c2eb-4e29-87ad-7a75ab7c10e3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.713725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2256f2-c2eb-4e29-87ad-7a75ab7c10e3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.713875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2256f2-c2eb-4e29-87ad-7a75ab7c10e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.758426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a86c8-486e-41e9-98b6-7b10baee7a76 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.800783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7b2256f2-c2eb-4e29-87ad-7a75ab7c10e3 None None] MFA Rules not processed for user `b311c94bb69d4189b6ea3d46a666fd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:06.804001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7b2256f2-c2eb-4e29-87ad-7a75ab7c10e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:06.884137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.884841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.885127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.885416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.887323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:06.887683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.889460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.900805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:06.912073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 903/1813] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:06.913065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2256f2-c2eb-4e29-87ad-7a75ab7c10e3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.928032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2256f2-c2eb-4e29-87ad-7a75ab7c10e3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.940564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.941683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.941683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.941965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.942220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 911/1814] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:06.943148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:06.944937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.951492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:06.972370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08464fae-e892-4d91-99eb-ef0d3f4203f0 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:06.985969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 904/1815] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/users => generated 299 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:06.991472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:06.993832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:06.996231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:06.996582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:06.997829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:06.998379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.002854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.014970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a69c7-d2f0-4995-bae0-fa4a3e82a412 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.020832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.021847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.022139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.022672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.024141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.026567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.048414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:07.054275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 912/1816] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:07.056030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.089586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 905/1817] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:06 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:07.091567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.173101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d50e8-36b3-4041-a40b-562456ef6ae2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.179481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.180209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.180493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.180771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.181629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.184495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.215671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 906/1818] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:07 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:07.219417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.226097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52da5e-4e11-45dc-9dab-5bf66f81a37d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.236071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5dde2-80ea-4c46-9d9d-c6b78141ac75 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.237836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.239477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.240218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.240605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.241651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.242214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.243181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.243515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.243827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.244598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.246245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.247203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.265043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 913/1819] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:07.268228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.279093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 907/1820] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:07 2022] POST /identity/v3/users => generated 288 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:07.280099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.292563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4a15e-676a-441c-847f-03bc362497b4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.297513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a0589-e107-4152-96ad-69cd3ca54cd2 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.298355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.299278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.299563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.300037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] PATH_INFO: `/v3/projects/ff40504d481545d99fe8e76dc0f03cb4/users/4b26e0f3d1334e6e8f91495f02052230/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.305750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.307546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.307961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.308876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.309736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.311916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.320474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff40504d481545d99fe8e76dc0f03cb4, user_id=4b26e0f3d1334e6e8f91495f02052230, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.323478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.325798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 914/1821] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:07.327056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.346689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9e79-a9f0-474b-9a38-b81ac3e3309e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.351376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 908/1822] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:07 2022] PUT /identity/v3/projects/ff40504d481545d99fe8e76dc0f03cb4/users/4b26e0f3d1334e6e8f91495f02052230/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:07.353431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.455165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.456025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.457489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.457489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.459804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.465072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.490613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 915/1823] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:07.496189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.503983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5990d4-0cb9-4330-a888-3d74538d9183 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.516773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.518098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.518651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.518931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] PATH_INFO: `/v3/projects/f0e7d0da0c124ff38d103c284a1eb92e/users/9c6805d1a92e4a5b8cdd00415eba7838/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.522264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68794deb-3b84-45a4-9152-979a942f4106 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.543387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.544474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.547321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.547808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.551808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.562351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e7d0da0c124ff38d103c284a1eb92e, user_id=9c6805d1a92e4a5b8cdd00415eba7838, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.568019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.569427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.604033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 909/1824] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:07 2022] PUT /identity/v3/projects/f0e7d0da0c124ff38d103c284a1eb92e/users/9c6805d1a92e4a5b8cdd00415eba7838/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:07.604033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.609790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 916/1825] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:07.611248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.627208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb71f2-1710-454e-a294-cef125b1a87e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.649709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:07.700341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e127b-6732-4d91-8f0d-a0998cb4d92c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.701586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:07.705761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.706546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.707805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.707805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.708162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.710518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.722228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.723215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.723845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.724309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.727737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 910/1826] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:07.727737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.728459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.733095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.749608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738b81-b0be-47af-9056-04174a546dcd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.753356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 917/1827] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:07.753356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.763287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00194d-81f5-4a1c-8b4c-9706b6492cf5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:07.770016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.771564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.771878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.772161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] PATH_INFO: `/v3/projects/ff40504d481545d99fe8e76dc0f03cb4/users/4b26e0f3d1334e6e8f91495f02052230/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.779395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff40504d481545d99fe8e76dc0f03cb4, user_id=4b26e0f3d1334e6e8f91495f02052230, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.782340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.803876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 911/1828] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:07 2022] PUT /identity/v3/projects/ff40504d481545d99fe8e76dc0f03cb4/users/4b26e0f3d1334e6e8f91495f02052230/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:07.804470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:07.808133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf3b70-8157-420a-8bdd-09dfe1fcd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:07.810164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3b70-8157-420a-8bdd-09dfe1fcd92d admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.812256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3b70-8157-420a-8bdd-09dfe1fcd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.812548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf3b70-8157-420a-8bdd-09dfe1fcd92d admin admin] PATH_INFO: `/v3/projects/5a8cab15699747239cd0261bc295df11/users/d91ea96ed9744c58a8bcc4e6aa6332cd/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.855812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf3b70-8157-420a-8bdd-09dfe1fcd92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8cab15699747239cd0261bc295df11, user_id=d91ea96ed9744c58a8bcc4e6aa6332cd, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:07.865221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf3b70-8157-420a-8bdd-09dfe1fcd92d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:07.900068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 918/1829] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:07 2022] PUT /identity/v3/projects/5a8cab15699747239cd0261bc295df11/users/d91ea96ed9744c58a8bcc4e6aa6332cd/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:07.903327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e8175-e35d-4096-b1a0-f843764e1b11 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:07.903327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e8175-e35d-4096-b1a0-f843764e1b11 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:07.903327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e8175-e35d-4096-b1a0-f843764e1b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:07.984624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3b4e8175-e35d-4096-b1a0-f843764e1b11 None None] MFA Rules not processed for user `4b26e0f3d1334e6e8f91495f02052230`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:07.989029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3b4e8175-e35d-4096-b1a0-f843764e1b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:08.002649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e902df-83ed-4f79-b670-1972b00ccf65 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:08.194056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 919/1830] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:08.196040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4f5b-4332-4129-8049-5f6e3e783e7d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.196435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4f5b-4332-4129-8049-5f6e3e783e7d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.196818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4f5b-4332-4129-8049-5f6e3e783e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.201377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:08.203639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.203924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.205965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] PATH_INFO: `/v3/projects/f0e7d0da0c124ff38d103c284a1eb92e/users/9c6805d1a92e4a5b8cdd00415eba7838/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.210986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e7d0da0c124ff38d103c284a1eb92e, user_id=9c6805d1a92e4a5b8cdd00415eba7838, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:08.223298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:08.263711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-041d4f5b-4332-4129-8049-5f6e3e783e7d None None] MFA Rules not processed for user `d91ea96ed9744c58a8bcc4e6aa6332cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:08.263711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-041d4f5b-4332-4129-8049-5f6e3e783e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:08.265782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 912/1831] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:07 2022] PUT /identity/v3/projects/f0e7d0da0c124ff38d103c284a1eb92e/users/9c6805d1a92e4a5b8cdd00415eba7838/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:08.274312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:08.288342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:08.443972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 920/1832] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:08.445299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.445586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.445861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.474328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45606f-9902-4276-95ed-23f8dab72bbc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:08.484274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19030-0e68-4458-abcf-13ff928ff6fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:08.485299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19030-0e68-4458-abcf-13ff928ff6fd service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.490072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19030-0e68-4458-abcf-13ff928ff6fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.490678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19030-0e68-4458-abcf-13ff928ff6fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.504755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:08.506890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] MFA Rules not processed for user `9c6805d1a92e4a5b8cdd00415eba7838`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:08.508473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:08.582603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:08.648489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19030-0e68-4458-abcf-13ff928ff6fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:08.650239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19030-0e68-4458-abcf-13ff928ff6fd service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:08.674271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 913/1833] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:08.686522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b1a6-8a81-46e9-8bc1-e9ae563a904c None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.687779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b1a6-8a81-46e9-8bc1-e9ae563a904c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.695495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b1a6-8a81-46e9-8bc1-e9ae563a904c None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.722768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 921/1834] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:08.736980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 914/1835] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:10:08 2022] GET /identity => generated 270 bytes in 62 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:10:08.737106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:08.741615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:08.757051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b1a6-8a81-46e9-8bc1-e9ae563a904c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:08.759358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fb70b1a6-8a81-46e9-8bc1-e9ae563a904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:08.785802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bd665-2744-4ba8-a097-6e08ea085858 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:08.801728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97d82e-320b-4f83-9050-352f9fa13589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:08.802416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97d82e-320b-4f83-9050-352f9fa13589 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.803364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97d82e-320b-4f83-9050-352f9fa13589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.803685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97d82e-320b-4f83-9050-352f9fa13589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.828625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97d82e-320b-4f83-9050-352f9fa13589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:08.830105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97d82e-320b-4f83-9050-352f9fa13589 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:08.846127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 922/1836] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:08.848141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.848440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.848721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.872742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:08.874872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:08.934686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b1a6-8a81-46e9-8bc1-e9ae563a904c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:08.945194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:08.945544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:08.945838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:08.946180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:08.957300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:08.959503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:09.021256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 915/1837] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:09.031119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:09.076946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 923/1838] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:10:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:09.077566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2d8e-f64c-4d83-961c-45fa3d4c1e21 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:09.085040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:09.085040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:09.086372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:09.086725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:09.092425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:09.258085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:09.259774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:09.289800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 916/1839] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:09.686623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:09.688481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:09.706720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8359794-666f-4beb-bf69-c75f84a22707 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:09.717608 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:09.719063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:09.720611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:09.721056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:09.742442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:09.746423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:09.769065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 924/1840] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:10:10.246308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:10.249417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:10.304300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:10.374490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9e85e-448b-4d2e-b5d6-ba6007d60de1 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:10.380156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:10.381339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:10.381855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:10.382345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] PATH_INFO: `/v3/users/f2174057821d49eabe2b7ffea258cf1c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:10.385334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2174057821d49eabe2b7ffea258cf1c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:10.388348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:10.455179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2174057821d49eabe2b7ffea258cf1c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.456337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2174057821d49eabe2b7ffea258cf1c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.467872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2174057821d49eabe2b7ffea258cf1c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.479297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2174057821d49eabe2b7ffea258cf1c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.481482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-651a1ea0-a1a9-4535-95d3-89af9c8577fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2174057821d49eabe2b7ffea258cf1c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.492265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:10.503073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b711071-d2b5-4245-812c-1d26270041f7 service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:10.507418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 917/1841] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:10 2022] DELETE /identity/v3/users/f2174057821d49eabe2b7ffea258cf1c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:10.508943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:10.512926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba680-26d3-4496-b593-24f08c38131b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:10.513715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba680-26d3-4496-b593-24f08c38131b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:10.513715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba680-26d3-4496-b593-24f08c38131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:10.517624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:10.517918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:10.518203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] PATH_INFO: `/v3/users/d91ea96ed9744c58a8bcc4e6aa6332cd` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:10.524735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91ea96ed9744c58a8bcc4e6aa6332cd)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:10.527325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:10.549704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-959ba680-26d3-4496-b593-24f08c38131b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:10.551081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-959ba680-26d3-4496-b593-24f08c38131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:10.609206 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91ea96ed9744c58a8bcc4e6aa6332cd'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.619823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91ea96ed9744c58a8bcc4e6aa6332cd'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.620564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91ea96ed9744c58a8bcc4e6aa6332cd'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.621239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91ea96ed9744c58a8bcc4e6aa6332cd'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.634031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4e874d95-bb35-423e-9436-9820b0ed5516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91ea96ed9744c58a8bcc4e6aa6332cd'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:10.649085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 918/1842] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:10.654052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:10.660746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ba680-26d3-4496-b593-24f08c38131b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:10.662540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-959ba680-26d3-4496-b593-24f08c38131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:10.671263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 925/1843] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:10 2022] DELETE /identity/v3/users/d91ea96ed9744c58a8bcc4e6aa6332cd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:10.676109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9adaa-1765-4ed5-8a47-ca59bd1af9f2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:10.676474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9adaa-1765-4ed5-8a47-ca59bd1af9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:10.676821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9adaa-1765-4ed5-8a47-ca59bd1af9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:10.706476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-4be9adaa-1765-4ed5-8a47-ca59bd1af9f2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:10.707744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-4be9adaa-1765-4ed5-8a47-ca59bd1af9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:10.727106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:10.734167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ba680-26d3-4496-b593-24f08c38131b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:10.807228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 926/1844] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:10.818082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9adaa-1765-4ed5-8a47-ca59bd1af9f2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:10.818292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:10.818865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:10.819169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:10.819442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:10.831146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:10.831439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9adaa-1765-4ed5-8a47-ca59bd1af9f2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:10.832877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:10.836601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:10.837370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:10.837710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:10.837999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:10.844842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 919/1845] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:10.851472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:10.855207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:10.872352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 927/1846] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:10:11.329198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:11.331028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:11.349690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bccbb-844f-4ece-ab04-e10617a27a2f service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:11.356517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:11.357499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:11.357853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:11.358203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] PATH_INFO: `/v3/projects/8129fa5a8d9245bbb64e936e0820281a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:11.360141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8129fa5a8d9245bbb64e936e0820281a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:11.362934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:11.389483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:11.391060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:11.405929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122a53-8677-48b3-9b3a-84c947e97ddc service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:11.411991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:11.412948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:11.413535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:11.413890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] PATH_INFO: `/v3/projects/5a8cab15699747239cd0261bc295df11` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:11.415705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8cab15699747239cd0261bc295df11)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:11.419068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:11.485100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8129fa5a8d9245bbb64e936e0820281a', 'request_id': 'req-e64aad93-3265-4764-8300-0f0e6adf1b0a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.490239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8cab15699747239cd0261bc295df11', 'request_id': 'req-1914c6ea-35dc-468e-821f-4d0000de2dd9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.498344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8129fa5a8d9245bbb64e936e0820281a', 'request_id': 'req-e64aad93-3265-4764-8300-0f0e6adf1b0a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.499990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8cab15699747239cd0261bc295df11', 'request_id': 'req-1914c6ea-35dc-468e-821f-4d0000de2dd9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.507233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8cab15699747239cd0261bc295df11', 'request_id': 'req-1914c6ea-35dc-468e-821f-4d0000de2dd9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.508753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8129fa5a8d9245bbb64e936e0820281a', 'request_id': 'req-e64aad93-3265-4764-8300-0f0e6adf1b0a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.523379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] The token cache is being invalidate because project 8129fa5a8d9245bbb64e936e0820281a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:11.524017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.524968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] The token cache is being invalidate because project 5a8cab15699747239cd0261bc295df11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:11.524968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.525989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.526104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1914c6ea-35dc-468e-821f-4d0000de2dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.529115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 928/1847] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:11 2022] DELETE /identity/v3/projects/5a8cab15699747239cd0261bc295df11 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:11.533473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 920/1848] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:11 2022] DELETE /identity/v3/projects/8129fa5a8d9245bbb64e936e0820281a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:11.534639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af917d-1a0f-430b-bd88-af4e5378b755 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:11.534779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:11.535043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af917d-1a0f-430b-bd88-af4e5378b755 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:11.535337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af917d-1a0f-430b-bd88-af4e5378b755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:11.536473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:11.578466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-87af917d-1a0f-430b-bd88-af4e5378b755 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:11.580643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-87af917d-1a0f-430b-bd88-af4e5378b755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:11.665208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aad93-3265-4764-8300-0f0e6adf1b0a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:11.690697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 929/1849] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:11.710787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728ebc-1cee-4eb2-9b73-615f521ee031 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:11.711265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728ebc-1cee-4eb2-9b73-615f521ee031 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:11.711765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728ebc-1cee-4eb2-9b73-615f521ee031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:11.732073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:11.740110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5b728ebc-1cee-4eb2-9b73-615f521ee031 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:11.741367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5b728ebc-1cee-4eb2-9b73-615f521ee031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:11.747927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:11.755214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 930/1850] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:11.762983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728ebc-1cee-4eb2-9b73-615f521ee031 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:11.777817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:11.778819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:11.779173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:11.779518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] PATH_INFO: `/v3/users/da9580a24b6a4213b0191fec7ab8a8c6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:11.780242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728ebc-1cee-4eb2-9b73-615f521ee031 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:11.781021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9580a24b6a4213b0191fec7ab8a8c6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:11.783233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:11.787753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:11.788931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:11.789338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:11.789746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:11.791014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:11.791417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:11.794489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:11.807807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 931/1851] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:10:11.812930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:11.824920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084814fd-ed72-4f51-b046-f1617ace7721 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:11.830010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:11.830735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:11.831018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:11.831377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:11.832178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:11.834118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:11.845975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9580a24b6a4213b0191fec7ab8a8c6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.846970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9580a24b6a4213b0191fec7ab8a8c6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.857832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9580a24b6a4213b0191fec7ab8a8c6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.863677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 932/1852] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:11 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:11.866426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9580a24b6a4213b0191fec7ab8a8c6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.867138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9580a24b6a4213b0191fec7ab8a8c6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:11.867667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:11.869671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:11.893404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 921/1853] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:11 2022] DELETE /identity/v3/users/da9580a24b6a4213b0191fec7ab8a8c6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:11.950779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead87bca-c923-4caf-8028-1412e1527e6e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.050803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.051485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.051804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.052081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.052832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.054787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.082965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 933/1854] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:11 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:12.089017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.108032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a099c49-34e0-44a3-bbb6-b88ba3b34319 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.114548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.115338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.116002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.116539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.117683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.120182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.139767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 922/1855] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:12.142467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.155757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53b64b-f48f-42a6-99a8-370a10402e37 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.163067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.163780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.164071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.164349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.165088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.166706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.184301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.191619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 934/1856] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:12.196949 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bcad8-ffb5-46ee-8a5c-195aa01ed487 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.203773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0a5d6-995e-4b26-b1f8-94bc8b5ff26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.204792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0a5d6-995e-4b26-b1f8-94bc8b5ff26c admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.205152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0a5d6-995e-4b26-b1f8-94bc8b5ff26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.205503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0a5d6-995e-4b26-b1f8-94bc8b5ff26c admin admin] PATH_INFO: `/v3/projects/12861667602d4c199f6c026a6aa78898/users/f303382d714c444daa6bfb0c2887fa13/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.231045 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0a5d6-995e-4b26-b1f8-94bc8b5ff26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12861667602d4c199f6c026a6aa78898, user_id=f303382d714c444daa6bfb0c2887fa13, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.236202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0a5d6-995e-4b26-b1f8-94bc8b5ff26c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.262660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.265104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.288415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 923/1857] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:12 2022] PUT /identity/v3/projects/12861667602d4c199f6c026a6aa78898/users/f303382d714c444daa6bfb0c2887fa13/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:12.299613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abc2e-3e11-4d3a-b755-d1fa4165d058 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.299891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abc2e-3e11-4d3a-b755-d1fa4165d058 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.300143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abc2e-3e11-4d3a-b755-d1fa4165d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.325061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20eae1-9443-437a-bbab-9fffe887e9d8 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.387647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-019abc2e-3e11-4d3a-b755-d1fa4165d058 None None] MFA Rules not processed for user `f303382d714c444daa6bfb0c2887fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:12.388898 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-019abc2e-3e11-4d3a-b755-d1fa4165d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.459985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:12.475411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.477507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.480229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.480811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] PATH_INFO: `/v3/projects/64e13d17d46347928ca24d3004d686d9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.482160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e13d17d46347928ca24d3004d686d9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.483679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 924/1858] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:12.488118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.488697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abc2e-3e11-4d3a-b755-d1fa4165d058 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.501589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abc2e-3e11-4d3a-b755-d1fa4165d058 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.506265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf281334-8bf7-4024-bdc2-ed1f370fb4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.506932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281334-8bf7-4024-bdc2-ed1f370fb4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.507368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281334-8bf7-4024-bdc2-ed1f370fb4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.507692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281334-8bf7-4024-bdc2-ed1f370fb4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.508384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf281334-8bf7-4024-bdc2-ed1f370fb4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.510313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf281334-8bf7-4024-bdc2-ed1f370fb4b8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.520137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:12.544576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 925/1859] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:12 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:12.545947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6750f5-002b-4c60-a78a-ad81dadfca8b None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.546242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6750f5-002b-4c60-a78a-ad81dadfca8b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.546525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6750f5-002b-4c60-a78a-ad81dadfca8b None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.547844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 926/1860] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:10:12.548599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6750f5-002b-4c60-a78a-ad81dadfca8b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.554904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e13d17d46347928ca24d3004d686d9', 'request_id': 'req-44a59e52-9f3a-4815-ad65-2c70fb369455'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:12.565317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e13d17d46347928ca24d3004d686d9', 'request_id': 'req-44a59e52-9f3a-4815-ad65-2c70fb369455'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:12.571950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e13d17d46347928ca24d3004d686d9', 'request_id': 'req-44a59e52-9f3a-4815-ad65-2c70fb369455'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:12.592200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] The token cache is being invalidate because project 64e13d17d46347928ca24d3004d686d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:12.592779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:12.593391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-44a59e52-9f3a-4815-ad65-2c70fb369455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:12.595146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 935/1861] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:12 2022] DELETE /identity/v3/projects/64e13d17d46347928ca24d3004d686d9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:12.596890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.597171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.597452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.617965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:12.619628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.642870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6750f5-002b-4c60-a78a-ad81dadfca8b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.647605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90e829-982d-42b9-b01c-49b687fa1f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.648322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90e829-982d-42b9-b01c-49b687fa1f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.648614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90e829-982d-42b9-b01c-49b687fa1f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.648896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90e829-982d-42b9-b01c-49b687fa1f11 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.649597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90e829-982d-42b9-b01c-49b687fa1f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.651563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90e829-982d-42b9-b01c-49b687fa1f11 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.676597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 927/1862] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:12 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:12.678549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.678842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.679119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.702441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:12.703712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.705590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 936/1863] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:10:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:12.706285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.707550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.720364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 928/1864] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:12.722620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b35c79-b68c-4a94-8ae7-486040f8dd40 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.724729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.728128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.728493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1872e-278a-4e88-87d7-e1805bec118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.729365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1872e-278a-4e88-87d7-e1805bec118b admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.730259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1872e-278a-4e88-87d7-e1805bec118b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.730364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1872e-278a-4e88-87d7-e1805bec118b admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.731107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1872e-278a-4e88-87d7-e1805bec118b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.733587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1872e-278a-4e88-87d7-e1805bec118b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.748880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 937/1865] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:12.750472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c9cf9-3d5e-4b0c-bcf9-e19329cfb88c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.750777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c9cf9-3d5e-4b0c-bcf9-e19329cfb88c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.751116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c9cf9-3d5e-4b0c-bcf9-e19329cfb88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.767392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d15827-bb95-4ea7-9939-4dd5f7425f51 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.775295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3a7c9cf9-3d5e-4b0c-bcf9-e19329cfb88c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:12.775689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.776576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.776689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3a7c9cf9-3d5e-4b0c-bcf9-e19329cfb88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.777553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.777822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.790603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.791156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 938/1866] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:12.793232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.793406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c9cf9-3d5e-4b0c-bcf9-e19329cfb88c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.805984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c9cf9-3d5e-4b0c-bcf9-e19329cfb88c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.812259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.813178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.813465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.813747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] PATH_INFO: `/v3/projects/a93cdb7bad3046f888ffa0bf34dc0bb1/users/5f5d5ca0bdb941f9bbd677afebb03bb5/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.830056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 929/1867] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:12.830056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.838412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93cdb7bad3046f888ffa0bf34dc0bb1, user_id=5f5d5ca0bdb941f9bbd677afebb03bb5, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.841552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.850360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73ab40-2405-4692-b4b5-ecd6861160eb service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.859608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.860385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.860681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.860966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.861953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:12.862387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 939/1868] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:12 2022] PUT /identity/v3/projects/a93cdb7bad3046f888ffa0bf34dc0bb1/users/5f5d5ca0bdb941f9bbd677afebb03bb5/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:12.862513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.864431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.866678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.895731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 930/1869] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:12.896673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.909621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:12.913254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3ca03-14db-4a85-bc19-d353ca6cf779 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.943293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f07a2-98a5-456d-b2e5-f39e471dd56b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.949110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.950179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.950479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.950942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.951712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.953438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.965146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 940/1870] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:12.968529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:12.971027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:12.989263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:12.989798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde10d6-14e7-4820-8019-75114af66f0f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:12.990267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:12.990579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:12.990901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:12.991718 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:12.994108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:12.997639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.000240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.000710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.001194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] PATH_INFO: `/v3/users/101624f8962443f393c8c171fe4f3b8b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.003343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101624f8962443f393c8c171fe4f3b8b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.008317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.024782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 931/1871] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:12 2022] POST /identity/v3/projects => generated 353 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:13.029437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.070373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:13.072117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101624f8962443f393c8c171fe4f3b8b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:13.080791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101624f8962443f393c8c171fe4f3b8b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:13.081373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101624f8962443f393c8c171fe4f3b8b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:13.081993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101624f8962443f393c8c171fe4f3b8b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:13.090459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101624f8962443f393c8c171fe4f3b8b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:13.110742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 941/1872] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:12 2022] DELETE /identity/v3/users/101624f8962443f393c8c171fe4f3b8b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:13.111717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053831a1-8693-4871-be36-0e673a759fe5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.111867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.114788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.178375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503ff2b-cc68-4b7d-91b4-e54e33aa3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.179604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503ff2b-cc68-4b7d-91b4-e54e33aa3c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.179981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503ff2b-cc68-4b7d-91b4-e54e33aa3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.180264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503ff2b-cc68-4b7d-91b4-e54e33aa3c19 admin admin] PATH_INFO: `/v3/projects/a93cdb7bad3046f888ffa0bf34dc0bb1/users/5f5d5ca0bdb941f9bbd677afebb03bb5/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.182618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503ff2b-cc68-4b7d-91b4-e54e33aa3c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93cdb7bad3046f888ffa0bf34dc0bb1, user_id=5f5d5ca0bdb941f9bbd677afebb03bb5, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.185434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503ff2b-cc68-4b7d-91b4-e54e33aa3c19 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.191241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0c693-6f27-4d3d-967e-ec42fb2784a3 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.198541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 932/1873] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:13 2022] PUT /identity/v3/projects/a93cdb7bad3046f888ffa0bf34dc0bb1/users/5f5d5ca0bdb941f9bbd677afebb03bb5/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:13.204957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d802-3510-4910-8e6c-3d8200e846bf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.205612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d802-3510-4910-8e6c-3d8200e846bf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.206054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d802-3510-4910-8e6c-3d8200e846bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.228169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bdd6d802-3510-4910-8e6c-3d8200e846bf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:13.229364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bdd6d802-3510-4910-8e6c-3d8200e846bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.245485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:13.263204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670bd49-8455-4242-86d2-3c9cbcc751f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.263816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670bd49-8455-4242-86d2-3c9cbcc751f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.264100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670bd49-8455-4242-86d2-3c9cbcc751f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.264412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670bd49-8455-4242-86d2-3c9cbcc751f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.265144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670bd49-8455-4242-86d2-3c9cbcc751f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.267096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670bd49-8455-4242-86d2-3c9cbcc751f4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.294467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 942/1874] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:13 2022] POST /identity/v3/users => generated 277 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:13.294467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b7e47-0cb6-42a7-add5-381d28d72d01 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.294467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b7e47-0cb6-42a7-add5-381d28d72d01 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.294467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b7e47-0cb6-42a7-add5-381d28d72d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.299430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 933/1875] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:13.300359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6d802-3510-4910-8e6c-3d8200e846bf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.310193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6d802-3510-4910-8e6c-3d8200e846bf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.317641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.318359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.318674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.319032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.319920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.321595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.330437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-2e9b7e47-0cb6-42a7-add5-381d28d72d01 None None] MFA Rules not processed for user `5f5d5ca0bdb941f9bbd677afebb03bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:13.331729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2e9b7e47-0cb6-42a7-add5-381d28d72d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.332498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 934/1876] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:13.333339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.334979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.394539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b78bd0-638f-4559-ab43-1bd89cb24976 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.398644 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.399303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.399719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.399889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.407642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 943/1877] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:13.409567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b7e47-0cb6-42a7-add5-381d28d72d01 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.410751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.412306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.422688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 935/1878] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:13.423302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b7e47-0cb6-42a7-add5-381d28d72d01 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.423513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.425427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.428210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.429229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.429711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.429999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.431030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.432611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:13.433651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.455033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 944/1879] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:13.459953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.477861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e359881-ca14-4895-b32a-bb48eed0d846 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.491157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fb257-2198-4caf-80c2-dbaf8b40b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.491698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fb257-2198-4caf-80c2-dbaf8b40b19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.494754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fb257-2198-4caf-80c2-dbaf8b40b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.495256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fb257-2198-4caf-80c2-dbaf8b40b19b admin admin] PATH_INFO: `/v3/projects/f80c3220e1e74ac5ba646b124a2ed1b1/users/3a31a777f8e940f3ac56b12eef0284b7/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.496221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03590a1a-9b00-4d6e-8c60-6d5af1883d35 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.500723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.501489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.501776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.502047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.514256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.515934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.529359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 936/1880] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:13.533197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fb257-2198-4caf-80c2-dbaf8b40b19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80c3220e1e74ac5ba646b124a2ed1b1, user_id=3a31a777f8e940f3ac56b12eef0284b7, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.535915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fb257-2198-4caf-80c2-dbaf8b40b19b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.555690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.558732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 945/1881] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:13 2022] PUT /identity/v3/projects/f80c3220e1e74ac5ba646b124a2ed1b1/users/3a31a777f8e940f3ac56b12eef0284b7/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:13.564286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.575628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf777-a358-4d66-bb91-8921bdede76d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.575628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf777-a358-4d66-bb91-8921bdede76d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.575628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf777-a358-4d66-bb91-8921bdede76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.580608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccbb42-c72c-4650-9890-3516d18b38f4 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.621411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e19bf777-a358-4d66-bb91-8921bdede76d None None] MFA Rules not processed for user `3a31a777f8e940f3ac56b12eef0284b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:13.623764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e19bf777-a358-4d66-bb91-8921bdede76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.657591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.658551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.659008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.660124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.662741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.729402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 946/1882] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:13.730230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf777-a358-4d66-bb91-8921bdede76d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.743003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf777-a358-4d66-bb91-8921bdede76d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.747511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.749757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.750215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.750504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.753088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:13.754035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.756107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.767623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 937/1883] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:13.767879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:13.768439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.841272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:13.845420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a464e0-cbe6-45b8-b1c5-50ca133a5159 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.848249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.850431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:13.850955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:13.851246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:13.851459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.851600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:13.852264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:13.855274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:13.882767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 947/1884] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:13.897882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 938/1885] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:13 2022] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:13.902418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.915735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6d1fb-0306-4e90-a23a-951e8c397109 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:13.924562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:13.926882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:14.130570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f9c1f-27e3-4a6b-9896-86cdd21a021d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:14.136884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:14.138026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.138316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.138803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] PATH_INFO: `/v3/projects/7bbf32d2e1c34c28b7bcc6b1d819efd3` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.140194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbf32d2e1c34c28b7bcc6b1d819efd3)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:14.142141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:14.184258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:14.185228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.185744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.186291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.187256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:14.189810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:14.220225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 948/1886] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:13 2022] POST /identity/v3/users => generated 285 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:14.237197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:14.268881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c1c0-17a6-45cb-9932-3e5d7226c78e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:14.294270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbf32d2e1c34c28b7bcc6b1d819efd3', 'request_id': 'req-876b4a97-e249-40c6-9b61-2a954528a88c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.316347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbf32d2e1c34c28b7bcc6b1d819efd3', 'request_id': 'req-876b4a97-e249-40c6-9b61-2a954528a88c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.328312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbf32d2e1c34c28b7bcc6b1d819efd3', 'request_id': 'req-876b4a97-e249-40c6-9b61-2a954528a88c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.360946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] The token cache is being invalidate because project 7bbf32d2e1c34c28b7bcc6b1d819efd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:14.362700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.371886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.375352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 939/1887] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:13 2022] DELETE /identity/v3/projects/7bbf32d2e1c34c28b7bcc6b1d819efd3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:14.381359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:14.384868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:14.421689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:14.423682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.423972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.424248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.424997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:14.426625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:14.462756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 949/1888] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:14.476753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:14.478795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:14.493386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe761e89-8102-43bb-8742-bf30a47e1a85 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:14.500203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:14.501257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.501607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.501945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] PATH_INFO: `/v3/projects/aa0b2662ced144fb8cb20ad79a640798/users/2781837bfc964279b4363d705dc46606/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.520078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0b2662ced144fb8cb20ad79a640798, user_id=2781837bfc964279b4363d705dc46606, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:14.523262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:14.532632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b4a97-e249-40c6-9b61-2a954528a88c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:14.541177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:14.543049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.543429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.543984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] PATH_INFO: `/v3/users/b311c94bb69d4189b6ea3d46a666fd81` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.546348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b311c94bb69d4189b6ea3d46a666fd81)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:14.548959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:14.554493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 950/1889] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:14 2022] PUT /identity/v3/projects/aa0b2662ced144fb8cb20ad79a640798/users/2781837bfc964279b4363d705dc46606/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:14.563240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:14.581197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:14.602178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:14.633834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b311c94bb69d4189b6ea3d46a666fd81'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.634584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b311c94bb69d4189b6ea3d46a666fd81'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.644345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b311c94bb69d4189b6ea3d46a666fd81'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.652879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b311c94bb69d4189b6ea3d46a666fd81'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.653569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b311c94bb69d4189b6ea3d46a666fd81'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:14.659223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523abf52-3c1d-4f8b-a3e0-be8064b57214 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:14.664672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acbc7d-5d10-4a60-865c-96d692a45802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:14.665337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acbc7d-5d10-4a60-865c-96d692a45802 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.665621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acbc7d-5d10-4a60-865c-96d692a45802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.665930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acbc7d-5d10-4a60-865c-96d692a45802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.666624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acbc7d-5d10-4a60-865c-96d692a45802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:14.668867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acbc7d-5d10-4a60-865c-96d692a45802 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:14.673177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 940/1890] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:14 2022] DELETE /identity/v3/users/b311c94bb69d4189b6ea3d46a666fd81 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:14.681345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 951/1891] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:14.685546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:14.687024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:14.764389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375602-8af6-4969-b51d-cd904b3e7060 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:14.769526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:14.770444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.770726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.771019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] PATH_INFO: `/v3/projects/aa0b2662ced144fb8cb20ad79a640798/users/2781837bfc964279b4363d705dc46606/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.773287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0b2662ced144fb8cb20ad79a640798, user_id=2781837bfc964279b4363d705dc46606, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:14.776083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:14.790712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 941/1892] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:14 2022] PUT /identity/v3/projects/aa0b2662ced144fb8cb20ad79a640798/users/2781837bfc964279b4363d705dc46606/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:14.802635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f86c-7af8-4fdb-8e96-5e67be693daa None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:14.803613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f86c-7af8-4fdb-8e96-5e67be693daa None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:14.803613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f86c-7af8-4fdb-8e96-5e67be693daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:14.837890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1de7f86c-7af8-4fdb-8e96-5e67be693daa None None] MFA Rules not processed for user `2781837bfc964279b4363d705dc46606`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:14.839500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1de7f86c-7af8-4fdb-8e96-5e67be693daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:14.975085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 952/1893] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:14 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:14.988789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:14.991124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:15.063048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a9e4d-3bcc-4aa8-bc42-57a1581d82be admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:15.067157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:15.068191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:15.068654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:15.069080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:15.084146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:15.087063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:15.114203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 942/1894] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:14 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:15.196749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f86c-7af8-4fdb-8e96-5e67be693daa None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:15.209093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f86c-7af8-4fdb-8e96-5e67be693daa None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:15.213531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:15.215377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:15.215945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:15.216423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:15.218566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:15.319434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:15.321097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:15.332009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 953/1895] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:15 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:15.735397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:15.739417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:15.827397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:15.893968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a3b66-5c24-4623-9aba-c1bd0c7e7f77 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:15.902567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:15.905391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:15.905687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:15.906573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] PATH_INFO: `/v3/projects/48d658f5552f4db78b1dcaedf2589a11` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:15.908875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d658f5552f4db78b1dcaedf2589a11)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:15.912102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:15.996322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d658f5552f4db78b1dcaedf2589a11', 'request_id': 'req-2765beaf-4947-4ee5-b408-03b1c9c5011b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.018036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d658f5552f4db78b1dcaedf2589a11', 'request_id': 'req-2765beaf-4947-4ee5-b408-03b1c9c5011b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.024967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d658f5552f4db78b1dcaedf2589a11', 'request_id': 'req-2765beaf-4947-4ee5-b408-03b1c9c5011b'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.039040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] The token cache is being invalidate because project 48d658f5552f4db78b1dcaedf2589a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:16.039361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.040024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.041689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 943/1896] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:15 2022] DELETE /identity/v3/projects/48d658f5552f4db78b1dcaedf2589a11 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:16.046480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:16.058742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e8b3-a279-4e22-b39d-b8db6f76e0b8 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:16.096263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:16.122990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:16.123908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:16.124641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:16.124641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] PATH_INFO: `/v3/users/9c6805d1a92e4a5b8cdd00415eba7838` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:16.125670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6805d1a92e4a5b8cdd00415eba7838)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:16.127614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:16.203228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6805d1a92e4a5b8cdd00415eba7838'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.210942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6805d1a92e4a5b8cdd00415eba7838'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.211692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6805d1a92e4a5b8cdd00415eba7838'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.212456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6805d1a92e4a5b8cdd00415eba7838'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.220107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-dc171bc4-133e-442f-b66f-98197012ab0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6805d1a92e4a5b8cdd00415eba7838'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.242818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 954/1897] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:16 2022] DELETE /identity/v3/users/9c6805d1a92e4a5b8cdd00415eba7838 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:16.621733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:16.623400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:16.679894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765beaf-4947-4ee5-b408-03b1c9c5011b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:16.769558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:16.770436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:16.770723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:16.771000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] PATH_INFO: `/v3/projects/f0e7d0da0c124ff38d103c284a1eb92e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:16.772213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e7d0da0c124ff38d103c284a1eb92e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:16.774114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:16.832868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e7d0da0c124ff38d103c284a1eb92e', 'request_id': 'req-0bead9e4-a65a-479b-b4d8-f422716f9585'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.841369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e7d0da0c124ff38d103c284a1eb92e', 'request_id': 'req-0bead9e4-a65a-479b-b4d8-f422716f9585'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.845465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:16.848921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e7d0da0c124ff38d103c284a1eb92e', 'request_id': 'req-0bead9e4-a65a-479b-b4d8-f422716f9585'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.864037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] The token cache is being invalidate because project f0e7d0da0c124ff38d103c284a1eb92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:16.864037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.864717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0bead9e4-a65a-479b-b4d8-f422716f9585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:16.866871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 944/1898] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:16 2022] DELETE /identity/v3/projects/f0e7d0da0c124ff38d103c284a1eb92e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:16.873442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecb364-b6dc-4443-a3c0-85e259e8cb88 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:16.873740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecb364-b6dc-4443-a3c0-85e259e8cb88 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:16.874090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecb364-b6dc-4443-a3c0-85e259e8cb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:16.900469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e9ecb364-b6dc-4443-a3c0-85e259e8cb88 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:16.902262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e9ecb364-b6dc-4443-a3c0-85e259e8cb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:16.978329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 955/1899] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:16.987551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13ea2-7a2d-4185-917c-60991a37b401 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:16.988039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13ea2-7a2d-4185-917c-60991a37b401 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:16.988422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13ea2-7a2d-4185-917c-60991a37b401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.008123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3ce13ea2-7a2d-4185-917c-60991a37b401 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:17.009390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3ce13ea2-7a2d-4185-917c-60991a37b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:17.036207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 945/1900] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:17.036409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecb364-b6dc-4443-a3c0-85e259e8cb88 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.047216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecb364-b6dc-4443-a3c0-85e259e8cb88 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.052023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.052694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.053149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.053731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.054635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:17.055098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.057161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.070530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 956/1901] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:10:17.074638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13ea2-7a2d-4185-917c-60991a37b401 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.086393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13ea2-7a2d-4185-917c-60991a37b401 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.092499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.093487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.093964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.094555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.095516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.097734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.138891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 946/1902] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:17 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:17.141421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.157695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d6c1-1e4b-4f8e-8e46-b0d1773534c4 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.242946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:17.274143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.274924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.275332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.275648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.277082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.279908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.306064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 957/1903] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:17 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:17.310673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.323914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87bd1-edbc-481e-9d56-2a8c18cd121a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.328800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.329478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.329777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.330057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.330802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.332480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.347381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 947/1904] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:17.351099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.364088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7c9f-8ef7-4f7f-8beb-0bae12d6323f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.369787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f92a3-710f-4c5d-b6c4-deb69699c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.370526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f92a3-710f-4c5d-b6c4-deb69699c51e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.370800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f92a3-710f-4c5d-b6c4-deb69699c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.371215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f92a3-710f-4c5d-b6c4-deb69699c51e admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.372059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f92a3-710f-4c5d-b6c4-deb69699c51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.373810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f92a3-710f-4c5d-b6c4-deb69699c51e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.389983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 958/1905] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:17.394205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.405684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c154c4-3dcb-4aa5-8bc0-1c4910aa0162 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.410775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.411728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.412139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.412436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] PATH_INFO: `/v3/projects/0c2a2c26f3e842ada728a04388e5a636/users/857f199ad37540d7bc3955a86dabee3d/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.429291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2a2c26f3e842ada728a04388e5a636, user_id=857f199ad37540d7bc3955a86dabee3d, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.431964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.450710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 948/1906] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:17 2022] PUT /identity/v3/projects/0c2a2c26f3e842ada728a04388e5a636/users/857f199ad37540d7bc3955a86dabee3d/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:17.463115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39644585-2f5a-4884-a8f8-ba243731350a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.463321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39644585-2f5a-4884-a8f8-ba243731350a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.463659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39644585-2f5a-4884-a8f8-ba243731350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.492251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-39644585-2f5a-4884-a8f8-ba243731350a None None] MFA Rules not processed for user `857f199ad37540d7bc3955a86dabee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:17.493614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-39644585-2f5a-4884-a8f8-ba243731350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:17.576214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 959/1907] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:17.581109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.677712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b978f8-d66d-44f4-ae88-370c19716878 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.683302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.684319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.684319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.684588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.685244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.687546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.724812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 949/1908] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:17 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:17.728415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39644585-2f5a-4884-a8f8-ba243731350a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.742243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39644585-2f5a-4884-a8f8-ba243731350a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.812456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.813236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.813578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.813922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.814633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.816576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.847736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 960/1909] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:17 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:17.849752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.857176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.859355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:17.862330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116726f5-c118-48f6-ad17-7ec508368077 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.869145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.869824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.870146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.870426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.871163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.872007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400c99-1080-4560-adff-ca2cbd795403 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.872793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.877009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.877887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.878174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.878450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] PATH_INFO: `/v3/users/f303382d714c444daa6bfb0c2887fa13` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.879705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f303382d714c444daa6bfb0c2887fa13)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.881652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.885235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 950/1910] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:17.890035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.903145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb6fbe-1b6e-4190-8578-d518c24859c0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:17.909588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:17.911893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.912432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:17.912890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] PATH_INFO: `/v3/projects/27f255a9126241eebf2dfedcfd1f8a0b/users/6cbc8cd7e49249d6b53143717043d813/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:17.930357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:17.933778 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f255a9126241eebf2dfedcfd1f8a0b, user_id=6cbc8cd7e49249d6b53143717043d813, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:17.936717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:17.946777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f303382d714c444daa6bfb0c2887fa13'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:17.953237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 951/1911] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:17 2022] PUT /identity/v3/projects/27f255a9126241eebf2dfedcfd1f8a0b/users/6cbc8cd7e49249d6b53143717043d813/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:17.956259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f303382d714c444daa6bfb0c2887fa13'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:17.956742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f303382d714c444daa6bfb0c2887fa13'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:17.957311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f303382d714c444daa6bfb0c2887fa13'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:17.957416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:17.959146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:17.965716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-46a8525d-54e0-4b65-8dce-54d450423aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f303382d714c444daa6bfb0c2887fa13'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:17.994306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 961/1912] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:17 2022] DELETE /identity/v3/users/f303382d714c444daa6bfb0c2887fa13 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:17.999679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579811e3-5962-4664-96bb-46b6f5393c3e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:17.999679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579811e3-5962-4664-96bb-46b6f5393c3e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:18.000050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579811e3-5962-4664-96bb-46b6f5393c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:18.024548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-579811e3-5962-4664-96bb-46b6f5393c3e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:18.026772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-579811e3-5962-4664-96bb-46b6f5393c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:18.044417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:18.088960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a7294-4a85-407c-8532-67647644572b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:18.162529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 962/1913] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:18.197455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68c650-45c7-4c97-b1b6-a85ee9c3cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:18.197455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c650-45c7-4c97-b1b6-a85ee9c3cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:18.197455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c650-45c7-4c97-b1b6-a85ee9c3cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:18.197455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c650-45c7-4c97-b1b6-a85ee9c3cff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:18.198619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c650-45c7-4c97-b1b6-a85ee9c3cff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:18.201021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c650-45c7-4c97-b1b6-a85ee9c3cff4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:18.235355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 952/1914] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:18.239564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579811e3-5962-4664-96bb-46b6f5393c3e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:18.252826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579811e3-5962-4664-96bb-46b6f5393c3e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:18.266938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:18.269611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:18.269611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:18.269611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] PATH_INFO: `/v3/projects/27f255a9126241eebf2dfedcfd1f8a0b/users/6cbc8cd7e49249d6b53143717043d813/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:18.271948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f255a9126241eebf2dfedcfd1f8a0b, user_id=6cbc8cd7e49249d6b53143717043d813, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:18.290950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:18.342603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 963/1915] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:18 2022] PUT /identity/v3/projects/27f255a9126241eebf2dfedcfd1f8a0b/users/6cbc8cd7e49249d6b53143717043d813/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:18.352272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:18.352608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:18.352841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:18.360761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:18.364463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:18.425674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] MFA Rules not processed for user `6cbc8cd7e49249d6b53143717043d813`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:18.429900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:18.500822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee71a-a526-4477-93c4-d550c49eaea1 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:18.505680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:18.506357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:18.506641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:18.506924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:18.546627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 953/1916] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:18.560958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:18.562694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:18.628687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:18.644891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:18.645353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5239ca-b77d-4bc2-98e9-07f47cfad45a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:18.647207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:18.650616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:18.651554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:18.651934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:18.652285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:18.661414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 964/1917] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:18.663143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:18.664742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:18.676638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 954/1918] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:10:18.814865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:18.828572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197baf1-58e4-4414-aac7-6bc1d7a92521 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:18.835214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:18.836492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:18.837053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:18.837535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:18.840525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:18.938672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:18.941437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:18.971909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 965/1919] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:19.321012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:19.324647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:19.357579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9168c8-832d-46ab-843d-6cbc26666a54 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:19.363760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:19.364752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:19.365138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:19.365513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] PATH_INFO: `/v3/projects/12861667602d4c199f6c026a6aa78898` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:19.366978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12861667602d4c199f6c026a6aa78898)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:19.369232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:19.374073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:19.469775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12861667602d4c199f6c026a6aa78898', 'request_id': 'req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.484241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12861667602d4c199f6c026a6aa78898', 'request_id': 'req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.501271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12861667602d4c199f6c026a6aa78898', 'request_id': 'req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.529222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] The token cache is being invalidate because project 12861667602d4c199f6c026a6aa78898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:19.529560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.532053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.538553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 955/1920] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:19 2022] DELETE /identity/v3/projects/12861667602d4c199f6c026a6aa78898 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:19.539667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:19.542083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:19.546057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:19.548821 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:19.568552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a713bb-3c47-495a-8259-bac57fcb17d9 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:19.724575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a655f-5f8a-41f0-95c6-9d2bfd1d6de9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:19.735055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:19.735983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:19.736278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:19.736613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] PATH_INFO: `/v3/users/5f5d5ca0bdb941f9bbd677afebb03bb5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:19.738960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5d5ca0bdb941f9bbd677afebb03bb5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:19.740937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:19.744367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:19.745295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:19.745584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:19.745861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] PATH_INFO: `/v3/users/c67ca8b9f8d04c17bef9dc39c9c685e6` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:19.747102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67ca8b9f8d04c17bef9dc39c9c685e6)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:19.749094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:19.820160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67ca8b9f8d04c17bef9dc39c9c685e6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.834485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5d5ca0bdb941f9bbd677afebb03bb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.835245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5d5ca0bdb941f9bbd677afebb03bb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.840223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67ca8b9f8d04c17bef9dc39c9c685e6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.841300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67ca8b9f8d04c17bef9dc39c9c685e6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.842241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67ca8b9f8d04c17bef9dc39c9c685e6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.854791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5c93488b-941c-4254-8078-3c946b8b541b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67ca8b9f8d04c17bef9dc39c9c685e6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.858002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5d5ca0bdb941f9bbd677afebb03bb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.870518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5d5ca0bdb941f9bbd677afebb03bb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.872565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5d5ca0bdb941f9bbd677afebb03bb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:19.901435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 966/1921] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:19 2022] DELETE /identity/v3/users/c67ca8b9f8d04c17bef9dc39c9c685e6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:19.904738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:19.904738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:19.904966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:19.921228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 956/1922] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:19 2022] DELETE /identity/v3/users/5f5d5ca0bdb941f9bbd677afebb03bb5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:19.928908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:19.937897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:19.939456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:20.056956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 967/1923] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:20.067930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:20.070937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:20.085118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:20.153003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d93b9-4f36-4aa4-a39f-81f06b6d584c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:20.156963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a0ea0-f207-4747-8c7f-61dcb462a327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:20.157860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a0ea0-f207-4747-8c7f-61dcb462a327 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:20.158178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a0ea0-f207-4747-8c7f-61dcb462a327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:20.158458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a0ea0-f207-4747-8c7f-61dcb462a327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:20.173952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a0ea0-f207-4747-8c7f-61dcb462a327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:20.174273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a0ea0-f207-4747-8c7f-61dcb462a327 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:20.186815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 957/1924] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:20.356565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:20.358724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:20.376333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa198ad6-d555-4f46-a693-64eb2916d6ad None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:20.382802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:20.384479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:20.385493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:20.385493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] PATH_INFO: `/v3/projects/a93cdb7bad3046f888ffa0bf34dc0bb1` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:20.386850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93cdb7bad3046f888ffa0bf34dc0bb1)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:20.389027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:20.475682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93cdb7bad3046f888ffa0bf34dc0bb1', 'request_id': 'req-b3c154eb-241a-4518-ba25-325b2b215d7e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.487718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93cdb7bad3046f888ffa0bf34dc0bb1', 'request_id': 'req-b3c154eb-241a-4518-ba25-325b2b215d7e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.505003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93cdb7bad3046f888ffa0bf34dc0bb1', 'request_id': 'req-b3c154eb-241a-4518-ba25-325b2b215d7e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.531999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] The token cache is being invalidate because project a93cdb7bad3046f888ffa0bf34dc0bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:20.532436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.533376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b3c154eb-241a-4518-ba25-325b2b215d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.536685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 968/1925] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:20 2022] DELETE /identity/v3/projects/a93cdb7bad3046f888ffa0bf34dc0bb1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:20.543084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af5482-b4f7-47ef-82f3-7eead32d4fd7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:20.543797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af5482-b4f7-47ef-82f3-7eead32d4fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:20.544080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af5482-b4f7-47ef-82f3-7eead32d4fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:20.565976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-84af5482-b4f7-47ef-82f3-7eead32d4fd7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:20.567271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-84af5482-b4f7-47ef-82f3-7eead32d4fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:20.670009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 958/1926] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:20.679897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2ac7-d8a6-49ac-8398-ddeba1e456ae None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:20.680426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2ac7-d8a6-49ac-8398-ddeba1e456ae None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:20.680426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2ac7-d8a6-49ac-8398-ddeba1e456ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:20.704622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-63ce2ac7-d8a6-49ac-8398-ddeba1e456ae None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:20.706015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-63ce2ac7-d8a6-49ac-8398-ddeba1e456ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:20.716689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 969/1927] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:20.721367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af5482-b4f7-47ef-82f3-7eead32d4fd7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:20.734689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af5482-b4f7-47ef-82f3-7eead32d4fd7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:20.739811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:20.740770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:20.741161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:20.741450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:20.742545 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:20.742866 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:20.744536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:20.760358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 959/1928] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:10:20.764568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2ac7-d8a6-49ac-8398-ddeba1e456ae None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:20.779741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2ac7-d8a6-49ac-8398-ddeba1e456ae None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:20.780128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:20.785649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:20.786528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:20.786883 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:20.787010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:20.787274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:20.788083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:20.790299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:20.803485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaefcc-9be4-4389-8e36-0c8a2b1ed69c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:20.809222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:20.810475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:20.810769 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:20.811052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] PATH_INFO: `/v3/projects/da84d0c8536349ef8cc40fabb764d3c6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:20.812450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da84d0c8536349ef8cc40fabb764d3c6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:20.815381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:20.869353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 970/1929] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:20 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:20.874060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:20.903939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da84d0c8536349ef8cc40fabb764d3c6', 'request_id': 'req-4b6c9103-91ba-4e80-a20e-5c553c8f8632'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.919531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da84d0c8536349ef8cc40fabb764d3c6', 'request_id': 'req-4b6c9103-91ba-4e80-a20e-5c553c8f8632'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.926848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da84d0c8536349ef8cc40fabb764d3c6', 'request_id': 'req-4b6c9103-91ba-4e80-a20e-5c553c8f8632'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.943097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] The token cache is being invalidate because project da84d0c8536349ef8cc40fabb764d3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:20.943722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.944830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:20.947233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 960/1930] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:20 2022] DELETE /identity/v3/projects/da84d0c8536349ef8cc40fabb764d3c6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:20.953660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:20.956492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:20.971826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990cfdc-587b-4e6a-97a2-e41ad1b9a2f4 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:20.978243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:21.004104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:21.076006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.078382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9103-91ba-4e80-a20e-5c553c8f8632 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.079179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.079590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.080057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.082814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.085001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.092226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.093140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.093428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.093707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] PATH_INFO: `/v3/users/4b26e0f3d1334e6e8f91495f02052230` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.095138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b26e0f3d1334e6e8f91495f02052230)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.100285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.116549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 971/1931] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:20 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:21.118219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.120855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:21.144589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421140d-8295-4f3a-83d8-9527aaf1fd0a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.150736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.152069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.152576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.152908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.153728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.155478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.167218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 972/1932] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:21.173639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b26e0f3d1334e6e8f91495f02052230'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.176375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b26e0f3d1334e6e8f91495f02052230'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.180380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.193547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38811ccc-d96d-4cb9-a872-83af15ca839b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.197210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b26e0f3d1334e6e8f91495f02052230'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.200324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.201034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.201320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.201603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.202347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.204948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.218365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 973/1933] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:21.218825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b26e0f3d1334e6e8f91495f02052230'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.219794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e4ae9170-6a2a-4fde-b5d6-5d06f0bcb658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b26e0f3d1334e6e8f91495f02052230'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.224553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.228417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:21.247138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 961/1934] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:20 2022] DELETE /identity/v3/users/4b26e0f3d1334e6e8f91495f02052230 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:21.250444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7816e65-ab80-4c08-aac4-63fb335a7a4d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.337760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.338872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.339172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.339455 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] PATH_INFO: `/v3/projects/6417af45061e4fa6b4d4de575633fc11/users/177c5378b31f4bcb94585845d93d2033/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.355907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6417af45061e4fa6b4d4de575633fc11, user_id=177c5378b31f4bcb94585845d93d2033, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.358611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.373720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 974/1935] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:21 2022] PUT /identity/v3/projects/6417af45061e4fa6b4d4de575633fc11/users/177c5378b31f4bcb94585845d93d2033/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:21.384217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.384516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.384804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.415175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] MFA Rules not processed for user `177c5378b31f4bcb94585845d93d2033`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:21.416606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:21.491078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 962/1936] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:21.495858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.570360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e367b98-3280-4491-a2bd-a82adf46e646 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.582415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.583226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.583521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.583874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.584714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.586863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.591701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:21.602785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.605893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:21.622215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 975/1937] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:21 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:21.625724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.626158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66290027-843e-4841-82c5-f83ed753b7d4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.665931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:21.708494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42911531-850c-4c77-b590-93ea3a65db63 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.713313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.714558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.714840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.714983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.715149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.715966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.716399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.716694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.716979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] PATH_INFO: `/v3/projects/ff40504d481545d99fe8e76dc0f03cb4` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.718050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.720083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff40504d481545d99fe8e76dc0f03cb4)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.722017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.745461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 976/1938] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:21 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:21.749887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.764093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97adbdc-2b39-4f69-89f8-2396d221db6a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.770485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.771164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.771450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.771769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.772769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.774385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.784130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff40504d481545d99fe8e76dc0f03cb4', 'request_id': 'req-e57d6cad-2589-4f44-bb81-41914ef206a2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.786300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 977/1939] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:21.790248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.794626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff40504d481545d99fe8e76dc0f03cb4', 'request_id': 'req-e57d6cad-2589-4f44-bb81-41914ef206a2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.800888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273b98-18fc-4da4-9c9e-755ec0575c88 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:21.803184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff40504d481545d99fe8e76dc0f03cb4', 'request_id': 'req-e57d6cad-2589-4f44-bb81-41914ef206a2'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.815488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] The token cache is being invalidate because project ff40504d481545d99fe8e76dc0f03cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:21.815824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.816485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e57d6cad-2589-4f44-bb81-41914ef206a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:21.823802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 963/1940] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:21 2022] DELETE /identity/v3/projects/ff40504d481545d99fe8e76dc0f03cb4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:21.825858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c8a9-b689-4a61-8899-197870ebad12 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.826334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c8a9-b689-4a61-8899-197870ebad12 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.826766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c8a9-b689-4a61-8899-197870ebad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.852800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a6c7c8a9-b689-4a61-8899-197870ebad12 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:21.854901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a6c7c8a9-b689-4a61-8899-197870ebad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:21.878896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:21.879834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.880121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.880406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] PATH_INFO: `/v3/projects/ab463c6e643c4384a9a003b97281e261/users/c54c90d0a884476396c753070c039ad6/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.901903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab463c6e643c4384a9a003b97281e261, user_id=c54c90d0a884476396c753070c039ad6, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:21.906165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:21.928487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 978/1941] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:21 2022] PUT /identity/v3/projects/ab463c6e643c4384a9a003b97281e261/users/c54c90d0a884476396c753070c039ad6/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:21.932227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:21.934061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:21.934906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 964/1942] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:21.943427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d5cb0-45e6-40a6-98a8-a771446f396e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:21.945407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d5cb0-45e6-40a6-98a8-a771446f396e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:21.945902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d5cb0-45e6-40a6-98a8-a771446f396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:21.971325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a41d5cb0-45e6-40a6-98a8-a771446f396e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:21.972791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a41d5cb0-45e6-40a6-98a8-a771446f396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:21.997017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:22.025118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88965691-b954-43e4-a5ab-195bcdd4b267 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.032366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.032942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.033231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.033511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.035179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.046778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.048989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 979/1943] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:22.053673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.068434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb35ae-3aca-4957-a061-2ec9fa8aa0bd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.071281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 965/1944] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:22.075027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892650d-3d3d-49dd-b2ca-de75cea79ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.076088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892650d-3d3d-49dd-b2ca-de75cea79ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.076405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d5cb0-45e6-40a6-98a8-a771446f396e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.076547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892650d-3d3d-49dd-b2ca-de75cea79ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.076814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892650d-3d3d-49dd-b2ca-de75cea79ba2 admin admin] PATH_INFO: `/v3/projects/ab463c6e643c4384a9a003b97281e261/users/c54c90d0a884476396c753070c039ad6/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.078936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892650d-3d3d-49dd-b2ca-de75cea79ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab463c6e643c4384a9a003b97281e261, user_id=c54c90d0a884476396c753070c039ad6, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.081717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892650d-3d3d-49dd-b2ca-de75cea79ba2 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.082821 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:22.091944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d5cb0-45e6-40a6-98a8-a771446f396e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.095745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 980/1945] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:22 2022] PUT /identity/v3/projects/ab463c6e643c4384a9a003b97281e261/users/c54c90d0a884476396c753070c039ad6/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:22.107397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.107862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.109322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.155358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] MFA Rules not processed for user `c54c90d0a884476396c753070c039ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:22.157093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:22.190525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.191524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.191950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.192329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.193255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:22.193698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.195474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.214554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 966/1946] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:22.219993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.234669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1d164-8e91-4034-a8fb-40de0ee342a6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.240376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.241187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.241340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.242089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.242340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.244519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.266416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 981/1947] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:22.281746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.285904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:22.289376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 967/1948] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:22 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:22.293994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.423471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341913c-4f0d-496c-96bf-0171ca2bf7de None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.464076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c60b-4d59-41c5-98ca-5b28a7379006 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.469260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.470027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.470390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.470743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.471613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.474245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.488145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.488813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.489143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.489432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.512191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 968/1949] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:22 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:22.513320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.520263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:22.537400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8dc6-dff8-47bf-b44b-4d42b91cf576 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.553569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.554391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.554688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.555226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.562335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.564483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.576001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.577673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.595277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 969/1950] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:22.595277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.597684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 982/1951] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:22.608204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2d7c-12a4-4675-b554-02d719d8cbe2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.613746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.614421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.614711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.614994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.615767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.617649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.633524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 970/1952] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:22.637556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.651663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f6f33-8497-4545-ad91-430b9450a194 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.658076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d4977-75d9-4f06-a489-46b499420f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.659088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d4977-75d9-4f06-a489-46b499420f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.659376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d4977-75d9-4f06-a489-46b499420f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.660347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d4977-75d9-4f06-a489-46b499420f3c admin admin] PATH_INFO: `/v3/projects/7c200db8a9134677a435d0b3a166f578/users/b2c45f6a69984406a9d54b356aeb6b48/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.683895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d4977-75d9-4f06-a489-46b499420f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c200db8a9134677a435d0b3a166f578, user_id=b2c45f6a69984406a9d54b356aeb6b48, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:22.687294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d4977-75d9-4f06-a489-46b499420f3c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:22.689657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:22.692609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:22.708053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 983/1953] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:22 2022] PUT /identity/v3/projects/7c200db8a9134677a435d0b3a166f578/users/b2c45f6a69984406a9d54b356aeb6b48/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:22.719839 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c46b8-2b08-403f-9f11-f121c7a06b8c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.721106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1db2ba-cb7c-4b10-aa38-dbd7c8d50400 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:22.721280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c46b8-2b08-403f-9f11-f121c7a06b8c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.721718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c46b8-2b08-403f-9f11-f121c7a06b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.781425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-531c46b8-2b08-403f-9f11-f121c7a06b8c None None] MFA Rules not processed for user `b2c45f6a69984406a9d54b356aeb6b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:22.783087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-531c46b8-2b08-403f-9f11-f121c7a06b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:22.822091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:22.844364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:22.846077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:22.846077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:22.848217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:22.852344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:22.969110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 984/1954] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:23.016683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:23.018268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:23.039439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 971/1955] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:10:23.063256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c46b8-2b08-403f-9f11-f121c7a06b8c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:23.074309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c46b8-2b08-403f-9f11-f121c7a06b8c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:23.078827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029f09-17e4-467f-98b7-998d57d1f590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:23.080185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029f09-17e4-467f-98b7-998d57d1f590 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:23.080516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029f09-17e4-467f-98b7-998d57d1f590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:23.080888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029f09-17e4-467f-98b7-998d57d1f590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:23.095690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029f09-17e4-467f-98b7-998d57d1f590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:23.097394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029f09-17e4-467f-98b7-998d57d1f590 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:23.111148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 985/1956] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:25.641494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:25.643082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:25.804931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98478c-75f4-44f1-b740-fb341ed57892 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:25.817496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:25.819672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:25.820310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:25.821075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] PATH_INFO: `/v3/users/857f199ad37540d7bc3955a86dabee3d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:25.823122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=857f199ad37540d7bc3955a86dabee3d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:25.832364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:25.939742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857f199ad37540d7bc3955a86dabee3d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:25.940416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857f199ad37540d7bc3955a86dabee3d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:25.951450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857f199ad37540d7bc3955a86dabee3d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:25.967974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857f199ad37540d7bc3955a86dabee3d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:25.969819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857f199ad37540d7bc3955a86dabee3d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.003942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 972/1957] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:25 2022] DELETE /identity/v3/users/857f199ad37540d7bc3955a86dabee3d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:26.009560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:26.010134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:26.010134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:26.042801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:26.042801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:26.114682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 986/1958] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:26.124896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:26.126310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:26.147059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:26.191247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc9730-bce0-47dd-9535-6ebd58caae9a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:26.194951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:26.195634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:26.195926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:26.196241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:26.206522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:26.208801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:26.220079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 973/1959] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:26.521467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:26.523109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:26.549379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745f4c3-d709-42b2-80f2-2859ffcfcc1e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:26.555350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:26.556255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:26.556603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:26.556807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] PATH_INFO: `/v3/projects/0c2a2c26f3e842ada728a04388e5a636` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:26.560506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2a2c26f3e842ada728a04388e5a636)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:26.562577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:26.573548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:26.618633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2a2c26f3e842ada728a04388e5a636', 'request_id': 'req-faebf267-96ba-4343-9847-f942ea740625'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.626891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2a2c26f3e842ada728a04388e5a636', 'request_id': 'req-faebf267-96ba-4343-9847-f942ea740625'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.633281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2a2c26f3e842ada728a04388e5a636', 'request_id': 'req-faebf267-96ba-4343-9847-f942ea740625'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.649053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] The token cache is being invalidate because project 0c2a2c26f3e842ada728a04388e5a636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:26.649347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.649971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.651567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 987/1960] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:26 2022] DELETE /identity/v3/projects/0c2a2c26f3e842ada728a04388e5a636 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:26.657389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:26.669477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67cd72-033f-43db-9da8-4f15d286d94d service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:26.758196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:26.760084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:26.761470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:26.761927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] PATH_INFO: `/v3/users/6cbc8cd7e49249d6b53143717043d813` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:26.763646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbc8cd7e49249d6b53143717043d813)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:26.766436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:26.844819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbc8cd7e49249d6b53143717043d813'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.845721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbc8cd7e49249d6b53143717043d813'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.855375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbc8cd7e49249d6b53143717043d813'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.870789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbc8cd7e49249d6b53143717043d813'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.872299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbc8cd7e49249d6b53143717043d813'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:26.900378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 974/1961] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:26 2022] DELETE /identity/v3/users/6cbc8cd7e49249d6b53143717043d813 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:27.282143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:27.284755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:27.301516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebf267-96ba-4343-9847-f942ea740625 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:27.302797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:27.304424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:27.381915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:27.389357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:27.390912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.391346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.392035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] PATH_INFO: `/v3/projects/27f255a9126241eebf2dfedcfd1f8a0b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.394155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f255a9126241eebf2dfedcfd1f8a0b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:27.397575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:27.414140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e4f68-deea-4591-bd5e-0ad8fd4e9da1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:27.432741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:27.433005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.433492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.434143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] PATH_INFO: `/v3/users/177c5378b31f4bcb94585845d93d2033` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.436340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177c5378b31f4bcb94585845d93d2033)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:27.439789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:27.495220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f255a9126241eebf2dfedcfd1f8a0b', 'request_id': 'req-4a5ef7db-2105-420a-84ea-091addb2b26d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.504539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f255a9126241eebf2dfedcfd1f8a0b', 'request_id': 'req-4a5ef7db-2105-420a-84ea-091addb2b26d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.515892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f255a9126241eebf2dfedcfd1f8a0b', 'request_id': 'req-4a5ef7db-2105-420a-84ea-091addb2b26d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.535650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] The token cache is being invalidate because project 27f255a9126241eebf2dfedcfd1f8a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:27.536397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.537723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4a5ef7db-2105-420a-84ea-091addb2b26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.540505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177c5378b31f4bcb94585845d93d2033'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.544791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 988/1962] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:27 2022] DELETE /identity/v3/projects/27f255a9126241eebf2dfedcfd1f8a0b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:27.544895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177c5378b31f4bcb94585845d93d2033'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.546489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d33b79-41b8-49be-a62d-394804a804a5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.546617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d33b79-41b8-49be-a62d-394804a804a5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.546819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d33b79-41b8-49be-a62d-394804a804a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.553379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177c5378b31f4bcb94585845d93d2033'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.570801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177c5378b31f4bcb94585845d93d2033'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.578850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-95a40257-7ae3-4f64-b1e3-c5b1f55ebc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177c5378b31f4bcb94585845d93d2033'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:27.588951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-88d33b79-41b8-49be-a62d-394804a804a5 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:27.591123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-88d33b79-41b8-49be-a62d-394804a804a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:27.602438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 975/1963] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:27 2022] DELETE /identity/v3/users/177c5378b31f4bcb94585845d93d2033 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:27.614497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:27.615045 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.615515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.615943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.645329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:27.646582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:27.696181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 989/1964] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:27.698712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a723cb-8407-4d4c-b25c-65a430802328 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.699003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a723cb-8407-4d4c-b25c-65a430802328 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.699281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a723cb-8407-4d4c-b25c-65a430802328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.726661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-46a723cb-8407-4d4c-b25c-65a430802328 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:27.728044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-46a723cb-8407-4d4c-b25c-65a430802328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:27.748007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 976/1965] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:27.758313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:27.759702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:27.806558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 990/1966] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:27.807616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a723cb-8407-4d4c-b25c-65a430802328 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:27.830521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a723cb-8407-4d4c-b25c-65a430802328 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:27.831384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec51576-ccb0-4528-858b-500472cd40af None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:27.837113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:27.837928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.839253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:27.839388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.839823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.841017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.841506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.841930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.843615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:27.844175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:27.846522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:27.851810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:27.854130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:27.861907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:27.866986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 991/1967] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:27.868105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:27.868594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 977/1968] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:27.879097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e055c50-e76a-46d3-b574-3052cf11873b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:27.884797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:27.886289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:27.886668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:27.887068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:27.887996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:27.889908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:27.922150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 992/1969] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:27 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:27.926096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:27.940743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12889e-c3a0-4d82-88da-463fd2c8cbaf service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.043230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.044147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.044590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.044975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.045799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.048959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.085154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 978/1970] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:27 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:28.091895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.112547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880902d-57a8-4119-964a-e7ee5362e9bb admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.120850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.122296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.122657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.123870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.124738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.126708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.141814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 993/1971] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:28.146189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.157760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb072c5-390a-4729-a9c5-de6756c87d2c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.164175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47c123-8545-49de-8cf2-578d157d0e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.164997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c123-8545-49de-8cf2-578d157d0e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.165354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c123-8545-49de-8cf2-578d157d0e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.165747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47c123-8545-49de-8cf2-578d157d0e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.166883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47c123-8545-49de-8cf2-578d157d0e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.170612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47c123-8545-49de-8cf2-578d157d0e5a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.193680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 979/1972] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:28.198937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.210088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6e0dc-a740-4fdb-8943-0b6ebd54540c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.215272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.216210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.216603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.216801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] PATH_INFO: `/v3/projects/95f2e363ce1447ab934422fe87b66f19/users/9e78d28782484d709a29b37b7473e45e/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.235958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f2e363ce1447ab934422fe87b66f19, user_id=9e78d28782484d709a29b37b7473e45e, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.239356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.255729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 994/1973] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:28 2022] PUT /identity/v3/projects/95f2e363ce1447ab934422fe87b66f19/users/9e78d28782484d709a29b37b7473e45e/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:28.270996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7ee2-af45-4e5a-ab7f-e9eb49bbbf63 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.271391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7ee2-af45-4e5a-ab7f-e9eb49bbbf63 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.271770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7ee2-af45-4e5a-ab7f-e9eb49bbbf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.304450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-10dd7ee2-af45-4e5a-ab7f-e9eb49bbbf63 None None] MFA Rules not processed for user `9e78d28782484d709a29b37b7473e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:28.306067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-10dd7ee2-af45-4e5a-ab7f-e9eb49bbbf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:28.325880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.327980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:28.390222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 980/1974] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:28.394710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd7ee2-af45-4e5a-ab7f-e9eb49bbbf63 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.398640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:28.403296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7c931-e13f-4486-b3b0-bb3902189736 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.405479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd7ee2-af45-4e5a-ab7f-e9eb49bbbf63 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.409462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.410331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.410458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.410637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.410888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] PATH_INFO: `/v3/projects/6417af45061e4fa6b4d4de575633fc11` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.410991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.411265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.411544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.412120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6417af45061e4fa6b4d4de575633fc11)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.412291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.414045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.414169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.442756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 981/1975] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:28 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:28.447125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.476612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6417af45061e4fa6b4d4de575633fc11', 'request_id': 'req-89a0e205-22d6-4396-9942-c7b094d35a6d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.487794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6417af45061e4fa6b4d4de575633fc11', 'request_id': 'req-89a0e205-22d6-4396-9942-c7b094d35a6d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.495453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6417af45061e4fa6b4d4de575633fc11', 'request_id': 'req-89a0e205-22d6-4396-9942-c7b094d35a6d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.510282 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:28.516992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] The token cache is being invalidate because project 6417af45061e4fa6b4d4de575633fc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:28.517285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.519306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.521490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 995/1976] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:28 2022] DELETE /identity/v3/projects/6417af45061e4fa6b4d4de575633fc11 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:28.526412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.528300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:28.534995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a2d2-135e-4fe2-aab6-e1ceaac509a0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.623503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.624471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.624862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.625266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.626064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.628276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.643977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e205-22d6-4396-9942-c7b094d35a6d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.649318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.650357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.650729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.654226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] PATH_INFO: `/v3/users/c54c90d0a884476396c753070c039ad6` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.654393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 982/1977] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:28 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:28.654504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54c90d0a884476396c753070c039ad6)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.654504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.655065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.657153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:28.671472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7dcc0-28e7-4782-ae1d-8c9f08aa49d3 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.677274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.677956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.678340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.678612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.679748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.681222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.694480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 983/1978] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:28.698839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.709472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cbb28-4893-40e4-b0ce-009bdb32bd4f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.711270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54c90d0a884476396c753070c039ad6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.714768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.716041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.716315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.716623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] PATH_INFO: `/v3/projects/cfedb89c6b6e487c98ab22e9b28025ae/users/eaf7611ea6ee4122b6e0dafdf8e9b2ae/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.723006 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54c90d0a884476396c753070c039ad6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.724044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54c90d0a884476396c753070c039ad6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.724960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54c90d0a884476396c753070c039ad6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.740509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfedb89c6b6e487c98ab22e9b28025ae, user_id=eaf7611ea6ee4122b6e0dafdf8e9b2ae, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.741668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54c90d0a884476396c753070c039ad6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:28.750723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.766334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 996/1979] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:28 2022] DELETE /identity/v3/users/c54c90d0a884476396c753070c039ad6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:28.770294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 984/1980] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:28 2022] PUT /identity/v3/projects/cfedb89c6b6e487c98ab22e9b28025ae/users/eaf7611ea6ee4122b6e0dafdf8e9b2ae/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:28.774296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.777534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:28.789803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:28.857333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a993fec-ce8a-42d7-b05d-2eb68b9f6b12 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.862888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaef32-f4bd-4b8c-83b8-d86ff846bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.863598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaef32-f4bd-4b8c-83b8-d86ff846bccc admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.863879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaef32-f4bd-4b8c-83b8-d86ff846bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.864211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaef32-f4bd-4b8c-83b8-d86ff846bccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.864885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaef32-f4bd-4b8c-83b8-d86ff846bccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.866498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaef32-f4bd-4b8c-83b8-d86ff846bccc admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.882644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 997/1981] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:28.886639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:28.961438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d53c6d-aac7-428f-8f62-28fe5c40e026 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:28.967792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:28.969341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.969660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.970259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] PATH_INFO: `/v3/projects/cfedb89c6b6e487c98ab22e9b28025ae/users/eaf7611ea6ee4122b6e0dafdf8e9b2ae/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:28.972340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfedb89c6b6e487c98ab22e9b28025ae, user_id=eaf7611ea6ee4122b6e0dafdf8e9b2ae, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:28.975267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:28.987114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 985/1982] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:28 2022] PUT /identity/v3/projects/cfedb89c6b6e487c98ab22e9b28025ae/users/eaf7611ea6ee4122b6e0dafdf8e9b2ae/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:28.998864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:28.999211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:28.999503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.042713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] MFA Rules not processed for user `eaf7611ea6ee4122b6e0dafdf8e9b2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:29.044459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:29.152802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 998/1983] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:29.164708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:29.166719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:29.191682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:29.193678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:29.253397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:29.273227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93460f2b-8c8a-4a00-b89b-6988ed499607 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:29.284321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:29.285386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.285677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.285984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.310410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:29.312856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:29.341727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 986/1984] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:29.353188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d73b43-3a4a-406c-9098-a8e260b58416 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:29.381519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:29.382391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.382673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.382955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] PATH_INFO: `/v3/projects/ab463c6e643c4384a9a003b97281e261` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.385721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab463c6e643c4384a9a003b97281e261)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:29.387982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:29.451943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:29.462947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:29.465138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:29.491608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382c1ea-43ff-4d07-aec0-b6dd3f38d6d1 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:29.492480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab463c6e643c4384a9a003b97281e261', 'request_id': 'req-0dd6e007-744a-43b7-ab9e-226291991889'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:29.503028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab463c6e643c4384a9a003b97281e261', 'request_id': 'req-0dd6e007-744a-43b7-ab9e-226291991889'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:29.512493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab463c6e643c4384a9a003b97281e261', 'request_id': 'req-0dd6e007-744a-43b7-ab9e-226291991889'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:29.533456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] The token cache is being invalidate because project ab463c6e643c4384a9a003b97281e261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:29.533918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:29.534863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0dd6e007-744a-43b7-ab9e-226291991889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:29.537041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 999/1985] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:29 2022] DELETE /identity/v3/projects/ab463c6e643c4384a9a003b97281e261 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:29.542991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8212e45-1e7a-4a9e-9724-01a095b36f3a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.543431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8212e45-1e7a-4a9e-9724-01a095b36f3a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.544989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8212e45-1e7a-4a9e-9724-01a095b36f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.587233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c8212e45-1e7a-4a9e-9724-01a095b36f3a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:29.588545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c8212e45-1e7a-4a9e-9724-01a095b36f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:29.633439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:29.634502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.634502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.634727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.639737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:29.709685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1000/1986] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:29.717681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb0dc-5ab1-4de9-84c8-0e03784861eb None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.718022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb0dc-5ab1-4de9-84c8-0e03784861eb None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.718266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb0dc-5ab1-4de9-84c8-0e03784861eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.743814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e01bb0dc-5ab1-4de9-84c8-0e03784861eb None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:29.745991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e01bb0dc-5ab1-4de9-84c8-0e03784861eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:29.750360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:29.755503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:29.765460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1001/1987] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:29.774050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb0dc-5ab1-4de9-84c8-0e03784861eb None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:29.783261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 987/1988] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:29.798936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb0dc-5ab1-4de9-84c8-0e03784861eb None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:29.805241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:29.806029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.806385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.807269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.809044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:29.809044 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:29.810225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:29.827904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1002/1989] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:10:29.829656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:29.844751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b814e-e6b7-41df-b5fe-d06dbdebcffe service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:29.851538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:29.852351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.853013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.853297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.854291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:29.856252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:29.895471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 988/1990] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:29 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:29.897106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:29.908688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7d2ce-aeab-4fb7-b0cb-5e5b44339702 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:29.980174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:29.981265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:29.981602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:29.982067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:29.982801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:29.984849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.019629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1003/1991] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:29 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:30.023133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.034988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de26b7b-895e-466e-81e6-46f36e223e0b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.040717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.041929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.042213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.042489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.043221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.044858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.061155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 989/1992] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:30.062624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.077671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c9c88-d37d-4828-97b4-2cf3ba582b9d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.082881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.083556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.083870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.084153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.084891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.086858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.090745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.092615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.101321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1004/1993] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:30.106356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.111037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34f842-9b1c-4e88-a1c1-4593cfa2080f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.117234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.120476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.121254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd347e-4a63-4839-9871-da36742da71d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.121609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.121957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] PATH_INFO: `/v3/users/9e78d28782484d709a29b37b7473e45e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.124933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e78d28782484d709a29b37b7473e45e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.126708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.133737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769432d-c2c1-4065-83a2-7fdbb5d1b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.134779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769432d-c2c1-4065-83a2-7fdbb5d1b19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.135132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769432d-c2c1-4065-83a2-7fdbb5d1b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.135472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769432d-c2c1-4065-83a2-7fdbb5d1b19e admin admin] PATH_INFO: `/v3/projects/b082525c34b74d27b069e36e0c56cbd2/users/43a5467f3fde40a19b9864e790796964/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.169419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769432d-c2c1-4065-83a2-7fdbb5d1b19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b082525c34b74d27b069e36e0c56cbd2, user_id=43a5467f3fde40a19b9864e790796964, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.173718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769432d-c2c1-4065-83a2-7fdbb5d1b19e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.176129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:30.199740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1005/1994] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:30 2022] PUT /identity/v3/projects/b082525c34b74d27b069e36e0c56cbd2/users/43a5467f3fde40a19b9864e790796964/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:30.209995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.210309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.210567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.213559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e78d28782484d709a29b37b7473e45e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.214929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e78d28782484d709a29b37b7473e45e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.225180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e78d28782484d709a29b37b7473e45e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.234240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:30.238339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e78d28782484d709a29b37b7473e45e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.239500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] MFA Rules not processed for user `43a5467f3fde40a19b9864e790796964`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:30.239756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6b30ad60-2e5f-4d9c-9815-aaf6538c75c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e78d28782484d709a29b37b7473e45e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.240766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.265309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 990/1995] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:30 2022] DELETE /identity/v3/users/9e78d28782484d709a29b37b7473e45e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:30.272364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.272786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.273520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.302499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:30.304468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.339178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1006/1996] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:30.341101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.342615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.403071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 991/1997] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:30.403071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.403740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.418158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db191bd-5ce6-42b0-a17b-d247e723eec9 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.427238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.428140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.428534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.429140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.431556 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.435267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.476758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8e2f0-06ed-40ec-bf9f-7e6c62681fcd None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.479388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 992/1998] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:30 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:30.480258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.481831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.554730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cca7d4-be99-4734-9673-9f3d0363497f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.562003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.562003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.562003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.562003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] PATH_INFO: `/v3/users/b2c45f6a69984406a9d54b356aeb6b48` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.563262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c45f6a69984406a9d54b356aeb6b48)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.565788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.567395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.568133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.568442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.568720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.580824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.582266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.594164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 993/1999] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:30.595008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.606092 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6419-df97-4d68-8ccd-46de4674914d service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.612693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.613391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.613870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.614119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.615199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.618209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.625449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:30.647058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c45f6a69984406a9d54b356aeb6b48'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.651957 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 994/2000] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:30 2022] POST /identity/v3/users => generated 299 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:30.656880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.661914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c45f6a69984406a9d54b356aeb6b48'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.663555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c45f6a69984406a9d54b356aeb6b48'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.665147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c45f6a69984406a9d54b356aeb6b48'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.669020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c627-c3d0-4da8-9de2-eda35afa8720 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.675021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.675987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.675987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.676519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.677264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.678572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a89e719f-b336-4221-b62b-7b6842882580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c45f6a69984406a9d54b356aeb6b48'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:30.678919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.694948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 995/2001] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:30.697218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.701793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.711904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1007/2002] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:30 2022] DELETE /identity/v3/users/b2c45f6a69984406a9d54b356aeb6b48 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:30.717569 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.717987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.718278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.738974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:30.739712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.759150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18602d4b-a385-4ea0-987a-c3fd0876bc29 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:30.837094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:30.881718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1008/2003] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:30.892060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:30.895086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:30.912026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:30.914361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:30.914744 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:30.915250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] PATH_INFO: `/v3/projects/39e5dfaa6e4f406792c05ac87ff8222f/users/3ab34aaee1244fdba1b391d7904e6a2d/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:30.950506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e5dfaa6e4f406792c05ac87ff8222f, user_id=3ab34aaee1244fdba1b391d7904e6a2d, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:30.954726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:30.982999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 996/2004] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:30 2022] PUT /identity/v3/projects/39e5dfaa6e4f406792c05ac87ff8222f/users/3ab34aaee1244fdba1b391d7904e6a2d/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:30.987109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:31.020719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b662e-7d05-4613-9c28-769512cabdbe None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:31.081335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a3771-c9e5-4a11-a02f-c96f1fabdc3a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:31.086736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27041ecb-4ec8-4df3-98f1-a705a95fa0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:31.086969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27041ecb-4ec8-4df3-98f1-a705a95fa0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:31.087168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:31.087293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27041ecb-4ec8-4df3-98f1-a705a95fa0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:31.087508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27041ecb-4ec8-4df3-98f1-a705a95fa0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:31.088687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:31.089068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:31.089829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:31.090367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:31.092654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:31.103719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27041ecb-4ec8-4df3-98f1-a705a95fa0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:31.105654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27041ecb-4ec8-4df3-98f1-a705a95fa0b3 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:31.110907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 997/2005] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:31.115830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:31.128274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532f57-82a1-4908-98d6-4d3215cc1a7c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:31.133955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:31.135896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:31.135896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:31.136163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] PATH_INFO: `/v3/projects/39e5dfaa6e4f406792c05ac87ff8222f/users/3ab34aaee1244fdba1b391d7904e6a2d/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:31.146784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e5dfaa6e4f406792c05ac87ff8222f, user_id=3ab34aaee1244fdba1b391d7904e6a2d, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:31.146784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:31.147057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1009/2006] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:31.170868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 998/2007] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:31 2022] PUT /identity/v3/projects/39e5dfaa6e4f406792c05ac87ff8222f/users/3ab34aaee1244fdba1b391d7904e6a2d/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:31.172372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:31.172726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:31.173014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:31.189786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:31.192972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:31.271619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:31.328994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] MFA Rules not processed for user `3ab34aaee1244fdba1b391d7904e6a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:31.333526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:31.350435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c453b-6861-4296-a269-ca84aeb5d475 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:31.358094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:31.359216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:31.359522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:31.359963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] PATH_INFO: `/v3/projects/95f2e363ce1447ab934422fe87b66f19` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:31.361344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f2e363ce1447ab934422fe87b66f19)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:31.363747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:31.442397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:31.464807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f2e363ce1447ab934422fe87b66f19', 'request_id': 'req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.465875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1010/2008] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:31.484787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:31.486706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:31.488357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f2e363ce1447ab934422fe87b66f19', 'request_id': 'req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.498004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f2e363ce1447ab934422fe87b66f19', 'request_id': 'req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.523422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] The token cache is being invalidate because project 95f2e363ce1447ab934422fe87b66f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:31.523970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.525385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.528043 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 999/2009] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:31 2022] DELETE /identity/v3/projects/95f2e363ce1447ab934422fe87b66f19 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:31.534801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:31.535935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:31.638054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb336c3-3e1e-4b49-a084-04cffbbdffdd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:31.644701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:31.645890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:31.646641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:31.646641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] PATH_INFO: `/v3/users/eaf7611ea6ee4122b6e0dafdf8e9b2ae` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:31.648313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf7611ea6ee4122b6e0dafdf8e9b2ae)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:31.650592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:31.652318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311b35-c036-4a31-9907-97bcef2b11e1 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:31.713467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf7611ea6ee4122b6e0dafdf8e9b2ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.714399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf7611ea6ee4122b6e0dafdf8e9b2ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.729647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf7611ea6ee4122b6e0dafdf8e9b2ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.738536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf7611ea6ee4122b6e0dafdf8e9b2ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.739316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf7611ea6ee4122b6e0dafdf8e9b2ae'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:31.764665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1000/2010] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:31 2022] DELETE /identity/v3/users/eaf7611ea6ee4122b6e0dafdf8e9b2ae => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:31.788364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:31.789036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:31.789394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:31.790223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:31.792616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:31.924563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:31.928847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:31.957659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:31.976949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1011/2011] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:10:32.080230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:32.082305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:32.220739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:32.263402 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159435-8d5a-41a6-9e1b-956c87c33ea9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:32.281403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59940358-279a-4796-8340-3f491568e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:32.282471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59940358-279a-4796-8340-3f491568e41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.282762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59940358-279a-4796-8340-3f491568e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.283428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59940358-279a-4796-8340-3f491568e41f admin admin] PATH_INFO: `/v3/projects/7c200db8a9134677a435d0b3a166f578` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.285216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59940358-279a-4796-8340-3f491568e41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c200db8a9134677a435d0b3a166f578)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:32.295118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59940358-279a-4796-8340-3f491568e41f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:32.395395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:32.396954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:32.414108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-59940358-279a-4796-8340-3f491568e41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c200db8a9134677a435d0b3a166f578', 'request_id': 'req-59940358-279a-4796-8340-3f491568e41f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.440191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff98c7-8533-484e-843a-dcb1600d2930 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:32.451963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-59940358-279a-4796-8340-3f491568e41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c200db8a9134677a435d0b3a166f578', 'request_id': 'req-59940358-279a-4796-8340-3f491568e41f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.464338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-59940358-279a-4796-8340-3f491568e41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c200db8a9134677a435d0b3a166f578', 'request_id': 'req-59940358-279a-4796-8340-3f491568e41f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.487499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-59940358-279a-4796-8340-3f491568e41f admin admin] The token cache is being invalidate because project 7c200db8a9134677a435d0b3a166f578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:32.488361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-59940358-279a-4796-8340-3f491568e41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.504038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-59940358-279a-4796-8340-3f491568e41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.511169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1001/2012] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:32 2022] DELETE /identity/v3/projects/7c200db8a9134677a435d0b3a166f578 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:32.515680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821e7d-d974-4449-9137-845e46d598d8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.516136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821e7d-d974-4449-9137-845e46d598d8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.516464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d821e7d-d974-4449-9137-845e46d598d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.543281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2d821e7d-d974-4449-9137-845e46d598d8 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:32.544743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d821e7d-d974-4449-9137-845e46d598d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:32.549512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:32.550380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.550736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.551097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] PATH_INFO: `/v3/projects/cfedb89c6b6e487c98ab22e9b28025ae` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.552669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfedb89c6b6e487c98ab22e9b28025ae)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:32.555068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:32.561655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1002/2013] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:32.570280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0b183-e32b-408b-a487-3d35f2e9b87f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.570618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0b183-e32b-408b-a487-3d35f2e9b87f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.570848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0b183-e32b-408b-a487-3d35f2e9b87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.593402 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d8b0b183-e32b-408b-a487-3d35f2e9b87f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:32.594580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d8b0b183-e32b-408b-a487-3d35f2e9b87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:32.610525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1003/2014] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:32.611605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0b183-e32b-408b-a487-3d35f2e9b87f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:32.625763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0b183-e32b-408b-a487-3d35f2e9b87f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:32.638945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfedb89c6b6e487c98ab22e9b28025ae', 'request_id': 'req-5b00b88c-5bf4-48e5-b32f-10308320a5fe'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.657087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfedb89c6b6e487c98ab22e9b28025ae', 'request_id': 'req-5b00b88c-5bf4-48e5-b32f-10308320a5fe'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.665061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfedb89c6b6e487c98ab22e9b28025ae', 'request_id': 'req-5b00b88c-5bf4-48e5-b32f-10308320a5fe'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.681880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] The token cache is being invalidate because project cfedb89c6b6e487c98ab22e9b28025ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:32.683729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.684579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5b00b88c-5bf4-48e5-b32f-10308320a5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:32.686395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1012/2015] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:32 2022] DELETE /identity/v3/projects/cfedb89c6b6e487c98ab22e9b28025ae => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:32.690864 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba9b1f-060c-463e-a090-6451080e06b0 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.691316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba9b1f-060c-463e-a090-6451080e06b0 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.691812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba9b1f-060c-463e-a090-6451080e06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.732454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:32.733734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.734543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.734832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.735838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:32.736157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:32.738286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:32.745150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-43ba9b1f-060c-463e-a090-6451080e06b0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:32.754101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-43ba9b1f-060c-463e-a090-6451080e06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:32.764904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1004/2016] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:32.766278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:32.769103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:32.781424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1013/2017] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:32.790214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255c601-062d-4169-8737-6688e8a29704 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:32.790678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932f26-d605-48ae-a282-ff1a1fdc02c0 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.791538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932f26-d605-48ae-a282-ff1a1fdc02c0 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.794161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932f26-d605-48ae-a282-ff1a1fdc02c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.796735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:32.797363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.797653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.797963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.798835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:32.801196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:32.843705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-01932f26-d605-48ae-a282-ff1a1fdc02c0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:32.845585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-01932f26-d605-48ae-a282-ff1a1fdc02c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:32.860775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1014/2018] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:32.861626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1005/2019] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:32 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:32.865821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01932f26-d605-48ae-a282-ff1a1fdc02c0 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:32.868672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:32.885180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01932f26-d605-48ae-a282-ff1a1fdc02c0 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:32.937737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:32.965015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:32.965694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.965976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.966252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.967007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:32.967285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:32.969167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:32.971497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b808b1-d691-4228-9c55-5900b4dcf1ee admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:32.979314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:32.980817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:32.980817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:32.980817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:32.981728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:32.983179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1015/2020] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:10:32.987805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:32.988128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.006272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332dcb7-f008-4d12-9733-4bd741187d3e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.013208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.016749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1006/2021] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:32 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:33.016895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.016895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.016895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.016895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.017567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.018917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.031095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:33.032830 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edccd3e-8587-4eb9-b0d8-621d8b166782 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.042619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.043318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.045055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.045055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.048359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.050189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.058251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1016/2022] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:32 2022] POST /identity/v3/projects => generated 361 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:33.063039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.067874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1007/2023] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:33.069093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.083620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9071a-0420-4634-b893-faddeba79b96 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.155246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ec0e-545b-410e-b52e-6558be91517a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.159845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.160436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.160559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.160762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.161044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.161150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.161381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.161658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.161777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.162352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.163927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.164406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.175405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1008/2024] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:33.176343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.178051 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.186894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1017/2025] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:33 2022] POST /identity/v3/users => generated 281 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:33.186894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.186894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.194700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a6ad-0dea-478b-a9b1-9a192ef72ffd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.200044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.200959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.201245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.201523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] PATH_INFO: `/v3/users/3a31a777f8e940f3ac56b12eef0284b7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.202289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01cddf-2a57-495e-add7-421b578a3668 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.203102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a31a777f8e940f3ac56b12eef0284b7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.205562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.207413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.208337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.208622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.209037 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] PATH_INFO: `/v3/users/43a5467f3fde40a19b9864e790796964` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.210465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a5467f3fde40a19b9864e790796964)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.214061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.254259 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a31a777f8e940f3ac56b12eef0284b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.254929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a31a777f8e940f3ac56b12eef0284b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.262469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a31a777f8e940f3ac56b12eef0284b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.263302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a5467f3fde40a19b9864e790796964'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.271704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a5467f3fde40a19b9864e790796964'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.272381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a5467f3fde40a19b9864e790796964'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.273043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a5467f3fde40a19b9864e790796964'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.278602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a31a777f8e940f3ac56b12eef0284b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.279463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a31a777f8e940f3ac56b12eef0284b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.283447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a5467f3fde40a19b9864e790796964'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:33.298994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1009/2026] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:33 2022] DELETE /identity/v3/users/3a31a777f8e940f3ac56b12eef0284b7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:33.301058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.303138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.307082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1018/2027] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:33 2022] DELETE /identity/v3/users/43a5467f3fde40a19b9864e790796964 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:33.307751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.309082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.334119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:33.376577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:33.383344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d34f19-f073-4e84-b30d-95e089995bb9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.392067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27034137-92a1-421c-95be-61e99a41248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.392993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27034137-92a1-421c-95be-61e99a41248e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.393278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27034137-92a1-421c-95be-61e99a41248e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.393565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27034137-92a1-421c-95be-61e99a41248e admin admin] PATH_INFO: `/v3/projects/9c53f3fa282d4b9390dd2f8ef56e8653/users/f5c917dbda4741309f45417d2f204c71/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.395953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be12d-7a0b-4dbd-8ade-f6665e7e686f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.402311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa26c-ceee-4c38-89e6-8036dee544d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.403427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa26c-ceee-4c38-89e6-8036dee544d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.403836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa26c-ceee-4c38-89e6-8036dee544d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.404179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa26c-ceee-4c38-89e6-8036dee544d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.405129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa26c-ceee-4c38-89e6-8036dee544d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.407501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa26c-ceee-4c38-89e6-8036dee544d5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.411920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27034137-92a1-421c-95be-61e99a41248e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c53f3fa282d4b9390dd2f8ef56e8653, user_id=f5c917dbda4741309f45417d2f204c71, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.414965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27034137-92a1-421c-95be-61e99a41248e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.425066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1019/2028] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:33.426350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.426641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.426919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.438890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1010/2029] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:33 2022] PUT /identity/v3/projects/9c53f3fa282d4b9390dd2f8ef56e8653/users/f5c917dbda4741309f45417d2f204c71/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:33.440514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191e38-2a28-4f3e-b215-cf874d7e03a7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.440811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191e38-2a28-4f3e-b215-cf874d7e03a7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.441094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04191e38-2a28-4f3e-b215-cf874d7e03a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.450434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:33.452950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.461673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-04191e38-2a28-4f3e-b215-cf874d7e03a7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:33.462915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-04191e38-2a28-4f3e-b215-cf874d7e03a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.527509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1020/2030] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:33.528634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.530236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.545031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9a48-696f-4a21-8151-98e7c5a4999e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.550874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1011/2031] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:33.554101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.554101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.554101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.554666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4abc2-59ea-4338-9a4b-4b58a9c6e42e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.554666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4abc2-59ea-4338-9a4b-4b58a9c6e42e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.555178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.555255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4abc2-59ea-4338-9a4b-4b58a9c6e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.555325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.555759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.568563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1021/2032] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:33.569494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.577109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.614186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-90d4abc2-59ea-4338-9a4b-4b58a9c6e42e None None] MFA Rules not processed for user `f5c917dbda4741309f45417d2f204c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:33.615422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-90d4abc2-59ea-4338-9a4b-4b58a9c6e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.656696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b37e-7248-4b92-8cdb-4fdd7058f1a3 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.660905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.661603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.661954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.662315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.676844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.678954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.694761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1022/2033] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:33.696031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.698153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.706572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1012/2034] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:33.707673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4abc2-59ea-4338-9a4b-4b58a9c6e42e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.713494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72238d2-2d69-4ec1-b302-d2e4dc0da830 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.719725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4abc2-59ea-4338-9a4b-4b58a9c6e42e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.724912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d04a2-7f21-4e01-96f6-a96b42968a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.726031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d04a2-7f21-4e01-96f6-a96b42968a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.726390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d04a2-7f21-4e01-96f6-a96b42968a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.726625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.726796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d04a2-7f21-4e01-96f6-a96b42968a01 admin admin] PATH_INFO: `/v3/projects/3eb074c4cb124625873deee80ba32c42/users/0530b817895f4d6dad39f8c0a7b22855/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.727613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.728275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.729495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.743795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.747205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.748540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d04a2-7f21-4e01-96f6-a96b42968a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb074c4cb124625873deee80ba32c42, user_id=0530b817895f4d6dad39f8c0a7b22855, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.752302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d04a2-7f21-4e01-96f6-a96b42968a01 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.761602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1023/2035] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:33.762570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.773874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc49eb-6309-4a2a-98c7-86c5ae2e7108 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.780869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.781553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.781842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.782314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.783354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.785546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:33.800841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1013/2036] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:33 2022] PUT /identity/v3/projects/3eb074c4cb124625873deee80ba32c42/users/0530b817895f4d6dad39f8c0a7b22855/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:33.823815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55712a-b3b4-47eb-8457-de23ff25b5cd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.824143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55712a-b3b4-47eb-8457-de23ff25b5cd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.824417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55712a-b3b4-47eb-8457-de23ff25b5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.831098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1024/2037] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:33 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:33.839223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:33.868579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:33.885939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9a55712a-b3b4-47eb-8457-de23ff25b5cd None None] MFA Rules not processed for user `0530b817895f4d6dad39f8c0a7b22855`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:33.887627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9a55712a-b3b4-47eb-8457-de23ff25b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:33.933771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:33.963293 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987cd6-8692-4a3c-a876-1c9a8c6ab171 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:33.970909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:33.972371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:33.972673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:33.973002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:33.973946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:33.977110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.010273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1025/2038] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:33 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:34.014583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.027126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481b6e3-0df1-4f50-9ed5-b93c8770af6a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.033055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.034221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.034221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.034364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.035020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.036674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.046076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1014/2039] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:34.049258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1026/2040] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:34.053396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55712a-b3b4-47eb-8457-de23ff25b5cd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.065020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.066008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55712a-b3b4-47eb-8457-de23ff25b5cd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.067906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.072457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.073236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.073526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.073806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.074544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.076901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.091396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1015/2041] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:34.095404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.107536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc374a-e98b-4268-b9ab-314f15ca7544 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.113252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f553c6-4a95-406d-bff9-bbda74f5a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.114211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f553c6-4a95-406d-bff9-bbda74f5a3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.114496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f553c6-4a95-406d-bff9-bbda74f5a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.114813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f553c6-4a95-406d-bff9-bbda74f5a3ec admin admin] PATH_INFO: `/v3/projects/3673880258e74724a34f849adada5028/users/a5eb735a7ba64acf8c3fed9ab865e07e/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.141375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f553c6-4a95-406d-bff9-bbda74f5a3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3673880258e74724a34f849adada5028, user_id=a5eb735a7ba64acf8c3fed9ab865e07e, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.145793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f553c6-4a95-406d-bff9-bbda74f5a3ec admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.167303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1016/2042] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:34 2022] PUT /identity/v3/projects/3673880258e74724a34f849adada5028/users/a5eb735a7ba64acf8c3fed9ab865e07e/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:34.173100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17833eb9-0469-4e20-8ce5-5d651bf28942 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.177484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.177785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.178132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.213239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] MFA Rules not processed for user `a5eb735a7ba64acf8c3fed9ab865e07e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:34.213841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.256858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.257584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.257873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.258296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.300210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1017/2043] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:34.301127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.302417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.334477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.336306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.347016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1027/2044] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:34.347951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.349642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.372137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:34.380961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8448-0549-4ac1-bc8c-5c3fecbe3eaa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.387122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.388136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.388419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.388691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] PATH_INFO: `/v3/projects/f80c3220e1e74ac5ba646b124a2ed1b1` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.389903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80c3220e1e74ac5ba646b124a2ed1b1)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.390605 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:34.391870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.426065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a9c5-27da-4c7b-aec1-390dfe9348e3 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.431116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.433306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.433306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.433306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] PATH_INFO: `/v3/projects/b082525c34b74d27b069e36e0c56cbd2` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.433898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b082525c34b74d27b069e36e0c56cbd2)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.435930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.446700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80c3220e1e74ac5ba646b124a2ed1b1', 'request_id': 'req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.455804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80c3220e1e74ac5ba646b124a2ed1b1', 'request_id': 'req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.463861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80c3220e1e74ac5ba646b124a2ed1b1', 'request_id': 'req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.478344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] The token cache is being invalidate because project f80c3220e1e74ac5ba646b124a2ed1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:34.478897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.479828 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.481787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1018/2045] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:34 2022] DELETE /identity/v3/projects/f80c3220e1e74ac5ba646b124a2ed1b1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:34.483088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.485124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.486349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b082525c34b74d27b069e36e0c56cbd2', 'request_id': 'req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.493171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b082525c34b74d27b069e36e0c56cbd2', 'request_id': 'req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.498641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b082525c34b74d27b069e36e0c56cbd2', 'request_id': 'req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.512262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] The token cache is being invalidate because project b082525c34b74d27b069e36e0c56cbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:34.512667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.513357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.514934 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1028/2046] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:34 2022] DELETE /identity/v3/projects/b082525c34b74d27b069e36e0c56cbd2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:34.519452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.519452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.559350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f03b8-a07f-4f43-a249-7f296f05a3ca admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.594411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84c90-dad0-48ee-82c8-ad03d4d2cf51 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.599248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.600163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.600468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.600745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] PATH_INFO: `/v3/users/0530b817895f4d6dad39f8c0a7b22855` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.601970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0530b817895f4d6dad39f8c0a7b22855)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.603988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.619860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.621381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.621668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.621969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.622675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.624681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.655991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1019/2047] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:34 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:34.655991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.655991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.656327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0530b817895f4d6dad39f8c0a7b22855'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.663412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0530b817895f4d6dad39f8c0a7b22855'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.664107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0530b817895f4d6dad39f8c0a7b22855'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.664815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0530b817895f4d6dad39f8c0a7b22855'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.672518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0530b817895f4d6dad39f8c0a7b22855'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.674317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:34.676486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:34.693965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1029/2048] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:34 2022] DELETE /identity/v3/users/0530b817895f4d6dad39f8c0a7b22855 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:34.697638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.697638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.728986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea9f58-eda7-418f-a04c-d6fece1827c8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.769531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd6c2-ddb1-40db-bb26-40f3f663ac0d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:34.776018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.777005 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.777296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.777577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] PATH_INFO: `/v3/users/3ab34aaee1244fdba1b391d7904e6a2d` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.778820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab34aaee1244fdba1b391d7904e6a2d)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.781063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.800197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:34.801098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.801662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.801662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] PATH_INFO: `/v3/users/2781837bfc964279b4363d705dc46606` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.802868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2781837bfc964279b4363d705dc46606)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:34.804992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:34.853704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab34aaee1244fdba1b391d7904e6a2d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.869399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab34aaee1244fdba1b391d7904e6a2d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.871831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab34aaee1244fdba1b391d7904e6a2d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.874216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab34aaee1244fdba1b391d7904e6a2d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.883026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab34aaee1244fdba1b391d7904e6a2d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.883667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2781837bfc964279b4363d705dc46606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.884503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2781837bfc964279b4363d705dc46606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.893833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2781837bfc964279b4363d705dc46606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.902907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2781837bfc964279b4363d705dc46606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.903654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f6db9ea1-06a7-4b43-b03e-218f9a901b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2781837bfc964279b4363d705dc46606'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:34.905301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1030/2049] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:34 2022] DELETE /identity/v3/users/3ab34aaee1244fdba1b391d7904e6a2d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:34.906376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:34.912522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.935685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1020/2050] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:34 2022] DELETE /identity/v3/users/2781837bfc964279b4363d705dc46606 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:34.935685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:34.935685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:34.935685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:34.954295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:34.955748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:34.993499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4eb80-ab49-448e-82eb-2fa6f9bbb960 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.011855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:35.024973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:35.055316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1021/2051] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:35.065804 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.067963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.071919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.072226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.072512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.072785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.073491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.075863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.102619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1031/2052] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:34 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:35.104567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.107116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.119391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7a18d-d313-4d3b-82bf-b980cd183160 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.124392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.125200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.125454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.125768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.126502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.128143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.143622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1032/2053] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:35.145838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.149941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1bbd-8680-4ef1-929e-f1b6176cffaf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.158458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88e99-921a-4c27-a217-94dd83fc2f37 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.165723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.178898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.182634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.182777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.183897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] PATH_INFO: `/v3/projects/cf90877937c2419992250d7a6bbb30f5/users/23a3adcc7d70404383960100fbb0072a/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.186563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.187844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.189568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.220390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.222894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.225353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf90877937c2419992250d7a6bbb30f5, user_id=23a3adcc7d70404383960100fbb0072a, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.227976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.234814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1022/2054] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:35.243637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1033/2055] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:35 2022] PUT /identity/v3/projects/cf90877937c2419992250d7a6bbb30f5/users/23a3adcc7d70404383960100fbb0072a/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:35.247470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.258900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89b93-88d1-4210-80d7-6146c4d4c02d service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.324944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeba37-3947-44a4-882c-4accbdc2becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.325665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeba37-3947-44a4-882c-4accbdc2becf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.325954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeba37-3947-44a4-882c-4accbdc2becf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.326238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeba37-3947-44a4-882c-4accbdc2becf admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.326973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeba37-3947-44a4-882c-4accbdc2becf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.328638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeba37-3947-44a4-882c-4accbdc2becf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.340145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1023/2056] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:35.344509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.355271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3f6a-f1c8-4c43-86f0-9b9e9cb24e45 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.360840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.361897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.362247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.362586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] PATH_INFO: `/v3/projects/cf90877937c2419992250d7a6bbb30f5/users/23a3adcc7d70404383960100fbb0072a/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.364782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf90877937c2419992250d7a6bbb30f5, user_id=23a3adcc7d70404383960100fbb0072a, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.367682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.380001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1034/2057] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:35 2022] PUT /identity/v3/projects/cf90877937c2419992250d7a6bbb30f5/users/23a3adcc7d70404383960100fbb0072a/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:35.392521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.392884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.393266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.423758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] MFA Rules not processed for user `23a3adcc7d70404383960100fbb0072a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:35.425135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.463996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.467810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.540689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1024/2058] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:35.541587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.543093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.565247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:35.581376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a71670-6b69-4e23-a5eb-976169b38e27 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.588453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.589421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.589778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.590127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] PATH_INFO: `/v3/projects/39e5dfaa6e4f406792c05ac87ff8222f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.592203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e5dfaa6e4f406792c05ac87ff8222f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.595737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.640621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b561f-f766-4fae-a17e-8f99b6c48c8c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.657894 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e5dfaa6e4f406792c05ac87ff8222f', 'request_id': 'req-8db91b0e-ee81-42c8-a78d-d7c99e38862e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.662131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:35.669328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e5dfaa6e4f406792c05ac87ff8222f', 'request_id': 'req-8db91b0e-ee81-42c8-a78d-d7c99e38862e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.678359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e5dfaa6e4f406792c05ac87ff8222f', 'request_id': 'req-8db91b0e-ee81-42c8-a78d-d7c99e38862e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.695713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] The token cache is being invalidate because project 39e5dfaa6e4f406792c05ac87ff8222f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:35.695967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.696677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.699410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1035/2059] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:35 2022] DELETE /identity/v3/projects/39e5dfaa6e4f406792c05ac87ff8222f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:35.700643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.701752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.709555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.710503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.710785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.711057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] PATH_INFO: `/v3/projects/aa0b2662ced144fb8cb20ad79a640798` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.712333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0b2662ced144fb8cb20ad79a640798)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.714339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.766345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0b2662ced144fb8cb20ad79a640798', 'request_id': 'req-279143d3-abfc-4f63-ba97-afa3a73afd39'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.768565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91b0e-ee81-42c8-a78d-d7c99e38862e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.774386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0b2662ced144fb8cb20ad79a640798', 'request_id': 'req-279143d3-abfc-4f63-ba97-afa3a73afd39'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.782924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0b2662ced144fb8cb20ad79a640798', 'request_id': 'req-279143d3-abfc-4f63-ba97-afa3a73afd39'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.797837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] The token cache is being invalidate because project aa0b2662ced144fb8cb20ad79a640798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:35.798134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.798823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-279143d3-abfc-4f63-ba97-afa3a73afd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:35.800467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1025/2060] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:35 2022] DELETE /identity/v3/projects/aa0b2662ced144fb8cb20ad79a640798 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:35.801697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.802285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.802285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.821427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:35.824119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.828356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b3b33-e5bc-41fa-99c0-0a38d1b55943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.829042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b3b33-e5bc-41fa-99c0-0a38d1b55943 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.829331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b3b33-e5bc-41fa-99c0-0a38d1b55943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.829612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b3b33-e5bc-41fa-99c0-0a38d1b55943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.831769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a28b3b33-e5bc-41fa-99c0-0a38d1b55943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.874275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:35.901378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1026/2061] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:35.902469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:35.903788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.909141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b3b33-e5bc-41fa-99c0-0a38d1b55943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.910810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b3b33-e5bc-41fa-99c0-0a38d1b55943 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.922911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc3ff0-638a-43e1-aec9-b13a63995915 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:35.927143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1036/2062] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:35.928404 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4cd4-94e0-42c1-be40-ec617bcb00dd None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.928719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4cd4-94e0-42c1-be40-ec617bcb00dd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.928996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4cd4-94e0-42c1-be40-ec617bcb00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.934296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:35.935341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.935646 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.935929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] PATH_INFO: `/v3/projects/3eb074c4cb124625873deee80ba32c42` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:35.939116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb074c4cb124625873deee80ba32c42)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:35.941298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:35.962537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-42ab4cd4-94e0-42c1-be40-ec617bcb00dd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:35.963747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-42ab4cd4-94e0-42c1-be40-ec617bcb00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:35.972827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1037/2063] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:35.974278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97000b68-33d7-4039-970d-89dbf1502305 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:35.974569 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97000b68-33d7-4039-970d-89dbf1502305 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:35.974844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97000b68-33d7-4039-970d-89dbf1502305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.014142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-97000b68-33d7-4039-970d-89dbf1502305 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:36.015495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-97000b68-33d7-4039-970d-89dbf1502305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:36.019977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb074c4cb124625873deee80ba32c42', 'request_id': 'req-dff4874d-de81-49bc-9afe-f488cc344cb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:36.033932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb074c4cb124625873deee80ba32c42', 'request_id': 'req-dff4874d-de81-49bc-9afe-f488cc344cb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:36.051339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb074c4cb124625873deee80ba32c42', 'request_id': 'req-dff4874d-de81-49bc-9afe-f488cc344cb5'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:36.068953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] The token cache is being invalidate because project 3eb074c4cb124625873deee80ba32c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:36.070059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:36.070857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dff4874d-de81-49bc-9afe-f488cc344cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:36.076253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1027/2064] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:35 2022] DELETE /identity/v3/projects/3eb074c4cb124625873deee80ba32c42 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:36.076253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7c428-5010-45ea-acdb-81cfba89a7ec None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.076253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7c428-5010-45ea-acdb-81cfba89a7ec None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.076750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7c428-5010-45ea-acdb-81cfba89a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.081729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:36.105542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1038/2065] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:36.106929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3933b6-7a06-4447-a9f0-983779e9f3c7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.107427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3933b6-7a06-4447-a9f0-983779e9f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.108146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3933b6-7a06-4447-a9f0-983779e9f3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.115530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fae7c428-5010-45ea-acdb-81cfba89a7ec None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:36.117674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fae7c428-5010-45ea-acdb-81cfba89a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:36.133076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0f3933b6-7a06-4447-a9f0-983779e9f3c7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:36.135234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0f3933b6-7a06-4447-a9f0-983779e9f3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:36.139745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1028/2066] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:36.141160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7c428-5010-45ea-acdb-81cfba89a7ec None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.152390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1039/2067] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:36.153226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3933b6-7a06-4447-a9f0-983779e9f3c7 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.154964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7c428-5010-45ea-acdb-81cfba89a7ec None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.162579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326bbe6-8c8e-4052-a598-a9e2da51e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.163716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326bbe6-8c8e-4052-a598-a9e2da51e9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.164090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326bbe6-8c8e-4052-a598-a9e2da51e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.164623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326bbe6-8c8e-4052-a598-a9e2da51e9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.165452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326bbe6-8c8e-4052-a598-a9e2da51e9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:36.165908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326bbe6-8c8e-4052-a598-a9e2da51e9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.166120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3933b6-7a06-4447-a9f0-983779e9f3c7 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.168320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326bbe6-8c8e-4052-a598-a9e2da51e9d3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.200187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.201264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.201662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.201998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.202750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:36.203241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.204467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1029/2068] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:36.205030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.206919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e3cf-51e2-48a2-a8c6-608445077e82 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.207275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e3cf-51e2-48a2-a8c6-608445077e82 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.207667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e3cf-51e2-48a2-a8c6-608445077e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.223723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1040/2069] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:36.225183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.230434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6239e3cf-51e2-48a2-a8c6-608445077e82 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:36.231812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6239e3cf-51e2-48a2-a8c6-608445077e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:36.236789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40219-1964-4187-a125-a2c192fd4de6 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.241733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1030/2070] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:36.241871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.242379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.242626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239e3cf-51e2-48a2-a8c6-608445077e82 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.242742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.242923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.243645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.245742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.253685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239e3cf-51e2-48a2-a8c6-608445077e82 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.260792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.261551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.261900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.262238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.263165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.265787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.285055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1041/2071] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:36.290540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.304497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1031/2072] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:36.304497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.418232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4a8e5-afbd-4ffc-84db-a1078b1a0084 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.427049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e97a-7184-4838-a558-d2cf58a4facd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.429349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.429349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.429349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.429349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.429984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.432612 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.440645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.442827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.443800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.444563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.446026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:36.446680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.449956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.466913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1042/2073] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:36.468334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1032/2074] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:36.468800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.471362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.480111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f06c66-b20f-4874-a244-21007760e03e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.483173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b3ad-3267-4d34-9aed-0d4f2d1f3ccd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.487627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.487627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.487627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.487627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.488040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.489564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.489994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.490891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.491141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.491436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.492176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.494579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.507945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:36.513598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1043/2075] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/users => generated 301 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:36.514430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.524810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af579db1-0ed9-4be8-98ee-3403919caf08 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.530237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.531168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.531453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.531763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.532496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.534113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.539715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1033/2076] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:36.540866 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.546713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1044/2077] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:36.547429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.559080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be08c7-a9be-4cf1-bc5e-c46c5e4001fb admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.619330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9d43-ee4f-4bbb-a5f7-b864fbb0badc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.626028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.626717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.627001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.627268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.628031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.629642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.635506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.636211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.636494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.636771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.637460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.639378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.640961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1034/2078] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:36.641897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.652864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c9fdf-174b-4968-86ba-fecd67dd2111 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.654445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:36.659187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.659799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.660317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.660620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.664357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.664524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1045/2079] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:36.664524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.664676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.673577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85a9dd-119f-46cc-8be9-84407cf957e9 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.676875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1035/2080] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:36.676875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.681205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.682358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.682643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.682928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.683779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.685409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.688123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fa194-9f38-435b-818c-4aa802a33bbd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.692837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.693494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.693782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.694063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.694789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.695844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1046/2081] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:36.696510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.699721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.707741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1036/2082] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:36.708671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.709427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98615-af0d-4358-b405-05ac01f4044a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.714023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.714888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.715169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.715443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] PATH_INFO: `/v3/projects/1f651a29c195448d8821c779d61a8508/users/b59baab122704b20a6261f52892d89be/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.718298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5114-fd84-467b-98cd-244951588d04 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.723012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62866b9e-74f8-4c76-9efe-c2128469fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.723857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866b9e-74f8-4c76-9efe-c2128469fc7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.724149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866b9e-74f8-4c76-9efe-c2128469fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.724434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866b9e-74f8-4c76-9efe-c2128469fc7f admin admin] PATH_INFO: `/v3/projects/e7c4b82b1fdd451c94d463138eb985fb/users/ff4108fbee1744deba6be91e7caa8928/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.730880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f651a29c195448d8821c779d61a8508, user_id=b59baab122704b20a6261f52892d89be, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.733551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.740509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866b9e-74f8-4c76-9efe-c2128469fc7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c4b82b1fdd451c94d463138eb985fb, user_id=ff4108fbee1744deba6be91e7caa8928, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.743668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866b9e-74f8-4c76-9efe-c2128469fc7f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.748036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1047/2083] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:36 2022] PUT /identity/v3/projects/1f651a29c195448d8821c779d61a8508/users/b59baab122704b20a6261f52892d89be/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:36.748654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.763965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1037/2084] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:36 2022] PUT /identity/v3/projects/e7c4b82b1fdd451c94d463138eb985fb/users/ff4108fbee1744deba6be91e7caa8928/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:36.765361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb033b-6cf0-432c-a681-6a9f51dcf3f1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.765650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb033b-6cf0-432c-a681-6a9f51dcf3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.765928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb033b-6cf0-432c-a681-6a9f51dcf3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.792818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-73eb033b-6cf0-432c-a681-6a9f51dcf3f1 None None] MFA Rules not processed for user `b59baab122704b20a6261f52892d89be`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:36.794027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-73eb033b-6cf0-432c-a681-6a9f51dcf3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:36.821572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fafd1b-353e-45f8-aebe-a26225ce32d7 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.860424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1038/2085] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:36.861796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bb87-8e29-4aef-8e35-826aef36f0ae None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.862087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bb87-8e29-4aef-8e35-826aef36f0ae None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.862360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92bb87-8e29-4aef-8e35-826aef36f0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.883620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.884285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.884588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.884867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.885630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.887948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.888928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2a92bb87-8e29-4aef-8e35-826aef36f0ae None None] MFA Rules not processed for user `ff4108fbee1744deba6be91e7caa8928`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:36.890129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2a92bb87-8e29-4aef-8e35-826aef36f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:36.898078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1048/2086] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:36.898875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.908077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:36.910372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca9873-6109-43a7-aaa4-e1355cee31e2 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.915361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:36.916563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:36.916844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:36.917170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:36.917857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:36.919797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:36.950166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1049/2087] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:36.950166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.961629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1039/2088] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:36.962796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92bb87-8e29-4aef-8e35-826aef36f0ae None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:36.975303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92bb87-8e29-4aef-8e35-826aef36f0ae None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:36.993574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:37.012244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06a9f2-8316-4f63-83c3-10bc781bc68d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.017490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.018390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.018676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.018955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] PATH_INFO: `/v3/projects/cc999b8c54b943ae9831a29e2d45c5bf/users/d932540855b44f3dbf25bb492958c086/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.033669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca041c83-6b13-4e63-a533-22d32a1dff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.034303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc999b8c54b943ae9831a29e2d45c5bf, user_id=d932540855b44f3dbf25bb492958c086, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.034423 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca041c83-6b13-4e63-a533-22d32a1dff6c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.034620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca041c83-6b13-4e63-a533-22d32a1dff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.034901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca041c83-6b13-4e63-a533-22d32a1dff6c admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.035616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca041c83-6b13-4e63-a533-22d32a1dff6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.036992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.037584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca041c83-6b13-4e63-a533-22d32a1dff6c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.051649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1050/2089] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:36 2022] PUT /identity/v3/projects/cc999b8c54b943ae9831a29e2d45c5bf/users/d932540855b44f3dbf25bb492958c086/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:37.052466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.060554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1040/2090] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:36 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:37.063397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2921-0023-4f72-a0ed-82667686492d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.063750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2921-0023-4f72-a0ed-82667686492d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.064184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2921-0023-4f72-a0ed-82667686492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.091891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c55d2921-0023-4f72-a0ed-82667686492d None None] MFA Rules not processed for user `d932540855b44f3dbf25bb492958c086`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:37.093095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c55d2921-0023-4f72-a0ed-82667686492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:37.120178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862df3c9-ad88-47be-9fa1-d04768473c4a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.124874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.125533 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.125817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.126090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.126795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.128827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.157559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1051/2091] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:37 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:37.158398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.159872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1041/2092] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:37.164832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d2921-0023-4f72-a0ed-82667686492d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.176037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d2921-0023-4f72-a0ed-82667686492d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.219394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:37.234788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b517-7b3b-4855-9489-8adc9e103c07 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.240143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.240815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.241096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.241381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.242102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.243732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.248289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.249066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.249436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.249722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.250560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.252665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.254851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1052/2093] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:37.255904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.259803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:37.275546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1042/2094] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:37 2022] POST /identity/v3/users => generated 307 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:37.276589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.292119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc999ec6-6c04-4099-b0db-1a55892edb6c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.298375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.299186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.299472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.299958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.300688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.302372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.317321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1043/2095] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:37.318529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.329343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:37.330032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e6db4-7dfe-4ae2-8942-46466fccbe32 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.336045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c090-f220-4a9b-8ae5-391615df2dea admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.338171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.338849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.339140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.339422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.340227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.341417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edd22f-591b-48b9-9dea-7f96c10fbcdf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.341792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.342067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd22f-591b-48b9-9dea-7f96c10fbcdf service glance] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.342350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd22f-591b-48b9-9dea-7f96c10fbcdf service glance] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.342624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd22f-591b-48b9-9dea-7f96c10fbcdf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.354865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1044/2096] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:37.356803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.369879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c4150-2c33-4278-a472-0fd867f0cb61 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.375508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.376434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.376714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.377037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] PATH_INFO: `/v3/projects/c886be5be65749839f73549f088f3608/users/9d6e92d69d2846c581101552933f8697/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.394737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c886be5be65749839f73549f088f3608, user_id=9d6e92d69d2846c581101552933f8697, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.397422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.406997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edd22f-591b-48b9-9dea-7f96c10fbcdf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.408464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edd22f-591b-48b9-9dea-7f96c10fbcdf service glance] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.412408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1045/2097] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:37 2022] PUT /identity/v3/projects/c886be5be65749839f73549f088f3608/users/9d6e92d69d2846c581101552933f8697/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:37.413199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.427755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1053/2098] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:37.429296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ffe3-2aba-46df-a500-b54f7fcbf8a4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.429710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ffe3-2aba-46df-a500-b54f7fcbf8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.429995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ffe3-2aba-46df-a500-b54f7fcbf8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.475413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-eb91ffe3-2aba-46df-a500-b54f7fcbf8a4 None None] MFA Rules not processed for user `9d6e92d69d2846c581101552933f8697`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:37.477916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-eb91ffe3-2aba-46df-a500-b54f7fcbf8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:37.524211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd929a0-e004-4c8f-8081-a890218211e4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.530344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.536134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.536533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.536937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] PATH_INFO: `/v3/projects/11a9bc686e3f4df2a571677777d06a88/users/57413e2834ad45afb73299ba9b115757/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.568399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a9bc686e3f4df2a571677777d06a88, user_id=57413e2834ad45afb73299ba9b115757, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.578143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.592788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1046/2099] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:37 2022] PUT /identity/v3/projects/11a9bc686e3f4df2a571677777d06a88/users/57413e2834ad45afb73299ba9b115757/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:37.596966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.604694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1054/2100] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:37.605611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ffe3-2aba-46df-a500-b54f7fcbf8a4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.630128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ffe3-2aba-46df-a500-b54f7fcbf8a4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.685799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fa9c9-d283-4a72-88ea-0bc380cf56f7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.693258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.694340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.694442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.694779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.695685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.697921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.708386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:37.716682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1047/2101] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:37.717942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.722306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:37.731009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.731720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.732007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.732287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.733661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.736080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.770693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1055/2102] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:37 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:37.772223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.807849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685da49-4416-4dfe-9a30-4388c1fec70c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.813706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:37.879141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95954a2-1c63-4ff8-9eee-0d3c4b2ac425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.880086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95954a2-1c63-4ff8-9eee-0d3c4b2ac425 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.880471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95954a2-1c63-4ff8-9eee-0d3c4b2ac425 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.880817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95954a2-1c63-4ff8-9eee-0d3c4b2ac425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.881087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b5e3-e9fe-44e1-9b32-5b9e14608831 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:37.883075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e95954a2-1c63-4ff8-9eee-0d3c4b2ac425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:37.887666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:37.888571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:37.888851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:37.889414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] PATH_INFO: `/v3/projects/11a9bc686e3f4df2a571677777d06a88/users/57413e2834ad45afb73299ba9b115757/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:37.892051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a9bc686e3f4df2a571677777d06a88, user_id=57413e2834ad45afb73299ba9b115757, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.894995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:37.907807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1056/2103] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:37 2022] PUT /identity/v3/projects/11a9bc686e3f4df2a571677777d06a88/users/57413e2834ad45afb73299ba9b115757/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:37.908717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:37.966218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95954a2-1c63-4ff8-9eee-0d3c4b2ac425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:37.969897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95954a2-1c63-4ff8-9eee-0d3c4b2ac425 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.000663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7eced0-2264-4df2-bd37-89c9307b579f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.001154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1048/2104] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:38.002858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.003211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.003437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.005858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.006540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.006826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.007106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.007875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.011625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.035739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1057/2105] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:37 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:38.038208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:38.047164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] MFA Rules not processed for user `57413e2834ad45afb73299ba9b115757`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:38.048770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:38.052791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737cd66-0ba2-4509-835c-41de7f2eb087 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.059011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.060003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.060282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.060590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.061450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.063214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.076388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1058/2106] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:38.080628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:38.091013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8411be-5a02-4219-8f5a-682776de4609 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.097428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.098416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.098714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.098978 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] PATH_INFO: `/v3/projects/ffe7a64863a4430cba8a4e8001a2f1d8/users/5bb3957bdc5642b5b36d4e631a6de19f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.115062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe7a64863a4430cba8a4e8001a2f1d8, user_id=5bb3957bdc5642b5b36d4e631a6de19f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.118086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.130816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:38.134240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1059/2107] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:38 2022] PUT /identity/v3/projects/ffe7a64863a4430cba8a4e8001a2f1d8/users/5bb3957bdc5642b5b36d4e631a6de19f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:38.139311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:38.145472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1049/2108] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:38.157486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:38.159132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:38.216306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ed0b1-28ec-48fa-9549-44f8735d2a45 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.221986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.222960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.223617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.223617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.224367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.224480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb749-5845-4af3-9522-e22cfa3e254c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.225987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.241516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1060/2109] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:38.243020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:38.250770 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:38.257238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754eebf-ddd7-4e35-9f09-fe2b4a604be2 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.263739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bedf11-7083-49ce-92f9-f655ad666c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.264651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bedf11-7083-49ce-92f9-f655ad666c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.264936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bedf11-7083-49ce-92f9-f655ad666c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.265212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bedf11-7083-49ce-92f9-f655ad666c8c admin admin] PATH_INFO: `/v3/projects/ffe7a64863a4430cba8a4e8001a2f1d8/users/5bb3957bdc5642b5b36d4e631a6de19f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.267343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bedf11-7083-49ce-92f9-f655ad666c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe7a64863a4430cba8a4e8001a2f1d8, user_id=5bb3957bdc5642b5b36d4e631a6de19f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.270280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bedf11-7083-49ce-92f9-f655ad666c8c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.281626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1061/2110] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:38 2022] PUT /identity/v3/projects/ffe7a64863a4430cba8a4e8001a2f1d8/users/5bb3957bdc5642b5b36d4e631a6de19f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:38.283954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.284624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.284903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.285174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.292345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe268-de9b-4900-9ba2-1137d0fe0a2d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.292648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe268-de9b-4900-9ba2-1137d0fe0a2d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.292908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe268-de9b-4900-9ba2-1137d0fe0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.327684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-69dfe268-de9b-4900-9ba2-1137d0fe0a2d None None] MFA Rules not processed for user `5bb3957bdc5642b5b36d4e631a6de19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:38.328936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-69dfe268-de9b-4900-9ba2-1137d0fe0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:38.368426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.370438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.383239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1050/2111] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:10:38.416877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1062/2112] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:38.444669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:38.453860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df06fb-6f7e-46d7-9ed7-0ed21c09503e service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.516383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.517132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.517523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.517880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.533193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:38.615644 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.617093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.629061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1051/2113] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:38.659266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe268-de9b-4900-9ba2-1137d0fe0a2d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:38.672282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe268-de9b-4900-9ba2-1137d0fe0a2d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:38.676461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:38.677175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:38.677558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:38.677923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:38.752664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:38.754121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:38.763752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1063/2114] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:39.106178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:39.120884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d7cb-831c-4b11-a67a-5ea541d2db16 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:39.125237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:39.126031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:39.126414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:39.126764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:39.128775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:39.242889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:39.244922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:39.261052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1052/2115] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:40.281218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:40.290784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3f921-69d6-4077-b908-def658f7863d service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:40.294832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:40.295582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:40.296025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:40.296313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:40.366818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:40.367674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:40.380766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1064/2116] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:41.135407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:41.143935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ec8ca-c05b-4d37-86f6-5cdd18fb783b service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:41.147478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28066b69-1fbd-47cc-9e4c-e3437ed28f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:41.148142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28066b69-1fbd-47cc-9e4c-e3437ed28f01 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:41.148423 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28066b69-1fbd-47cc-9e4c-e3437ed28f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:41.148697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28066b69-1fbd-47cc-9e4c-e3437ed28f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:41.158444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28066b69-1fbd-47cc-9e4c-e3437ed28f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:41.159888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28066b69-1fbd-47cc-9e4c-e3437ed28f01 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:41.169361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1053/2117] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:43.078551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:43.092117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:43.145272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2605b48-c5fc-4753-a75d-2a62a33b34fb service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:43.150018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:43.150888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:43.151165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:43.151433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] PATH_INFO: `/v3/users/ff4108fbee1744deba6be91e7caa8928` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:43.152685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4108fbee1744deba6be91e7caa8928)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:43.154643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:43.207509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4108fbee1744deba6be91e7caa8928'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.215048 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4108fbee1744deba6be91e7caa8928'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.215796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4108fbee1744deba6be91e7caa8928'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.216411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4108fbee1744deba6be91e7caa8928'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.224616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4108fbee1744deba6be91e7caa8928'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.248917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1065/2118] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:43 2022] DELETE /identity/v3/users/ff4108fbee1744deba6be91e7caa8928 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:43.253655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:43.254493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:43.254926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:43.277838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:43.279346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:43.387321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1054/2119] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:43.401140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:43.402843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:43.469603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:43.471112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:43.484875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238d2c-3b7b-4872-a636-cf3cb80433aa admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:43.485325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a11b7-79ed-4d86-b05c-5f05a9471920 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:43.489183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43124f-716a-4cfd-be67-c508f16b58a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:43.489845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43124f-716a-4cfd-be67-c508f16b58a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:43.490133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43124f-716a-4cfd-be67-c508f16b58a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:43.490559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43124f-716a-4cfd-be67-c508f16b58a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:43.491014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:43.492048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:43.492432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:43.492810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] PATH_INFO: `/v3/users/f5c917dbda4741309f45417d2f204c71` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:43.494745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c917dbda4741309f45417d2f204c71)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:43.497017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:43.502007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43124f-716a-4cfd-be67-c508f16b58a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:43.503489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43124f-716a-4cfd-be67-c508f16b58a5 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:43.516257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1066/2120] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:43.541751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:43.563618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c917dbda4741309f45417d2f204c71'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.564569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c917dbda4741309f45417d2f204c71'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.578040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c917dbda4741309f45417d2f204c71'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.588593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c917dbda4741309f45417d2f204c71'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.589435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c917dbda4741309f45417d2f204c71'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:43.612713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1055/2121] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:43 2022] DELETE /identity/v3/users/f5c917dbda4741309f45417d2f204c71 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:43.617517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:43.617937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:43.618319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:43.639116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:43.640790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:43.680378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:43.747072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1067/2122] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:43.764954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:43.767739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:43.868874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aad495-03bc-4a1d-9107-d871d13e398d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:43.873679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:43.874858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:43.875260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:43.875588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:43.904851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:43.906993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:43.908751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:43.910353 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:43.928190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1056/2123] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:43.941503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf290e-5836-46b3-bdba-3ea915c41c9d None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:43.949303 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:43.950263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:43.950548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:43.950895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] PATH_INFO: `/v3/projects/e7c4b82b1fdd451c94d463138eb985fb` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:43.952275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c4b82b1fdd451c94d463138eb985fb)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:43.954955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:44.048071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c4b82b1fdd451c94d463138eb985fb', 'request_id': 'req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.056176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c4b82b1fdd451c94d463138eb985fb', 'request_id': 'req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.064932 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c4b82b1fdd451c94d463138eb985fb', 'request_id': 'req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.093702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] The token cache is being invalidate because project e7c4b82b1fdd451c94d463138eb985fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:44.095001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.096151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.098966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1068/2124] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:43 2022] DELETE /identity/v3/projects/e7c4b82b1fdd451c94d463138eb985fb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:44.103635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:44.116883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6ed12-ebd0-44d3-9ddc-d31d97d06712 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:44.229524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:44.230590 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:44.230704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:44.231042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] PATH_INFO: `/v3/users/57413e2834ad45afb73299ba9b115757` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:44.232431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57413e2834ad45afb73299ba9b115757)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:44.234404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:44.299883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57413e2834ad45afb73299ba9b115757'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.302603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57413e2834ad45afb73299ba9b115757'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.313578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:44.315274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:44.324234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57413e2834ad45afb73299ba9b115757'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.329081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:44.339762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caa4c4-ee8f-4d1b-b6c7-43c1a20d0411 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:44.345791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:44.346670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:44.346955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:44.347234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] PATH_INFO: `/v3/projects/9c53f3fa282d4b9390dd2f8ef56e8653` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:44.348801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57413e2834ad45afb73299ba9b115757'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.348920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c53f3fa282d4b9390dd2f8ef56e8653)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:44.350143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57413e2834ad45afb73299ba9b115757'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.350697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:44.378420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1057/2125] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:44 2022] DELETE /identity/v3/users/57413e2834ad45afb73299ba9b115757 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:44.445038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c53f3fa282d4b9390dd2f8ef56e8653', 'request_id': 'req-48c082c7-3942-46f9-807b-a64537cb5d0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.460912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c53f3fa282d4b9390dd2f8ef56e8653', 'request_id': 'req-48c082c7-3942-46f9-807b-a64537cb5d0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.486938 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c53f3fa282d4b9390dd2f8ef56e8653', 'request_id': 'req-48c082c7-3942-46f9-807b-a64537cb5d0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.527666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] The token cache is being invalidate because project 9c53f3fa282d4b9390dd2f8ef56e8653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:44.528361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.529358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.535662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:44.536687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1069/2126] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:44 2022] DELETE /identity/v3/projects/9c53f3fa282d4b9390dd2f8ef56e8653 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:44.537895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:44.682706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615452-e823-4f28-b04c-d07524992557 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:44.750643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:44.751492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:44.751812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:44.752091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] PATH_INFO: `/v3/users/a5eb735a7ba64acf8c3fed9ab865e07e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:44.753326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5eb735a7ba64acf8c3fed9ab865e07e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:44.755283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:44.811949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:44.813739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:44.822617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5eb735a7ba64acf8c3fed9ab865e07e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.823300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5eb735a7ba64acf8c3fed9ab865e07e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.837136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5eb735a7ba64acf8c3fed9ab865e07e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.860211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5eb735a7ba64acf8c3fed9ab865e07e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.865450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-df28f340-a08d-4b72-8cdc-c45988e9bcc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5eb735a7ba64acf8c3fed9ab865e07e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.866264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c082c7-3942-46f9-807b-a64537cb5d0e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:44.875563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:44.876478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:44.876760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:44.877032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] PATH_INFO: `/v3/projects/11a9bc686e3f4df2a571677777d06a88` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:44.878231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a9bc686e3f4df2a571677777d06a88)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:44.880201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:44.889992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:44.900120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1058/2127] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:44 2022] DELETE /identity/v3/users/a5eb735a7ba64acf8c3fed9ab865e07e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:44.933399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:44.945816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a9bc686e3f4df2a571677777d06a88', 'request_id': 'req-342501ac-54c9-40e3-a12c-a91e7c3963b3'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.958142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a9bc686e3f4df2a571677777d06a88', 'request_id': 'req-342501ac-54c9-40e3-a12c-a91e7c3963b3'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.967270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a9bc686e3f4df2a571677777d06a88', 'request_id': 'req-342501ac-54c9-40e3-a12c-a91e7c3963b3'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.983011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] The token cache is being invalidate because project 11a9bc686e3f4df2a571677777d06a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:44.983315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.984124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-342501ac-54c9-40e3-a12c-a91e7c3963b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:44.985810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1070/2128] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:44 2022] DELETE /identity/v3/projects/11a9bc686e3f4df2a571677777d06a88 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:44.994326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058e096-69a7-428d-abe9-fad18f8d709b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:44.994668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058e096-69a7-428d-abe9-fad18f8d709b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:44.995729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058e096-69a7-428d-abe9-fad18f8d709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.018977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a058e096-69a7-428d-abe9-fad18f8d709b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:45.020350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a058e096-69a7-428d-abe9-fad18f8d709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.111627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1059/2129] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:45.120164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e4ba3-203a-47f5-82c1-270974e6c7d0 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.120706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e4ba3-203a-47f5-82c1-270974e6c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.120706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e4ba3-203a-47f5-82c1-270974e6c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.145835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b26e4ba3-203a-47f5-82c1-270974e6c7d0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:45.147081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b26e4ba3-203a-47f5-82c1-270974e6c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.158088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1071/2130] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:45.162917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058e096-69a7-428d-abe9-fad18f8d709b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.175731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058e096-69a7-428d-abe9-fad18f8d709b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.182086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.182787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.183079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.183350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.184221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:45.184545 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.186198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.199254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1060/2131] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:45.204149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e4ba3-203a-47f5-82c1-270974e6c7d0 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.215239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e4ba3-203a-47f5-82c1-270974e6c7d0 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.224262 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.224592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.224889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.225162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.226368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.228586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.273035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1072/2132] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:45 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:45.278320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.296160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2531f6-b223-45e9-a5a4-74c0ced7d2bf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.331456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.333465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.389923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.391509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.392027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.392954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.394110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.397838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.417112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752987d-4a57-4a7e-84fe-efc4a1c446ee admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.433755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1061/2133] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:45 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:45.434237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.435268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.435548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.435853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] PATH_INFO: `/v3/users/b59baab122704b20a6261f52892d89be` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.436180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.438523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.439865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59baab122704b20a6261f52892d89be)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.442078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.458995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23ed21-a7f4-4bfa-83cf-656c79272ea9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.466971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.467813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.468130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.468429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] PATH_INFO: `/v3/projects/3673880258e74724a34f849adada5028` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.469789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3673880258e74724a34f849adada5028)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.471772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.522990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59baab122704b20a6261f52892d89be'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.535800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59baab122704b20a6261f52892d89be'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.537564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59baab122704b20a6261f52892d89be'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.538590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59baab122704b20a6261f52892d89be'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.562578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59baab122704b20a6261f52892d89be'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.581588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3673880258e74724a34f849adada5028', 'request_id': 'req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.595111 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3673880258e74724a34f849adada5028', 'request_id': 'req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.604932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3673880258e74724a34f849adada5028', 'request_id': 'req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.610667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1073/2134] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:45 2022] DELETE /identity/v3/users/b59baab122704b20a6261f52892d89be => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:45.611784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.615469 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:45.615891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.629764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] The token cache is being invalidate because project 3673880258e74724a34f849adada5028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:45.630859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.632063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1bcc8468-dc72-4bf5-91da-73fc66ffd1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.638465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1062/2135] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:45 2022] DELETE /identity/v3/projects/3673880258e74724a34f849adada5028 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:45.639311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:45.641562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.642096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.642608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.672398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:45.674080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.707775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd829a3d-cbbe-4c82-a6dd-2695b5e6bc0d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.713830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.714954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.715268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.715552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.716413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.718562 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.730113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1074/2136] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:45.730971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.732832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.749063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aadd7-b7c6-4f5d-9554-efdbc88143f5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.754405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.755439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.755593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.755862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] PATH_INFO: `/v3/users/23a3adcc7d70404383960100fbb0072a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.757275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a3adcc7d70404383960100fbb0072a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.759865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.772432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1063/2137] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:45.774132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.786299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.804225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01856775-e312-4e18-915f-fcf15b7db765 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:45.810790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:45.811416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:45.811740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:45.812160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:45.813291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:45.815546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:45.835459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1064/2138] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:45.836133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.838191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a3adcc7d70404383960100fbb0072a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.840703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.851903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a3adcc7d70404383960100fbb0072a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.853520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a3adcc7d70404383960100fbb0072a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.854208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a3adcc7d70404383960100fbb0072a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.864697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a3adcc7d70404383960100fbb0072a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:45.898175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1075/2139] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:45 2022] DELETE /identity/v3/users/23a3adcc7d70404383960100fbb0072a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:45.900466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:45.902155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:45.964558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f4579-b399-4280-bd3d-ead0f2d4cd4c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:46.058153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff9443-1e6e-4034-957e-daebc580ca3c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:46.060675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20886b-0db3-4772-926d-2ebac42d5b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:46.061360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20886b-0db3-4772-926d-2ebac42d5b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.061648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20886b-0db3-4772-926d-2ebac42d5b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.062054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20886b-0db3-4772-926d-2ebac42d5b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.063984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-df20886b-0db3-4772-926d-2ebac42d5b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:46.074498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:46.075452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.075783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.076032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] PATH_INFO: `/v3/projects/a2edfd7037ce47f5a3fd50f4725265a7/users/43da600d0d174d96aab7b188c5090857/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.083889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20886b-0db3-4772-926d-2ebac42d5b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:46.086380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20886b-0db3-4772-926d-2ebac42d5b87 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:46.101371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1065/2140] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:46.114171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2edfd7037ce47f5a3fd50f4725265a7, user_id=43da600d0d174d96aab7b188c5090857, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:46.117414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:46.144594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1076/2141] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:45 2022] PUT /identity/v3/projects/a2edfd7037ce47f5a3fd50f4725265a7/users/43da600d0d174d96aab7b188c5090857/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:46.156732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.157035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.157356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.195726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] MFA Rules not processed for user `43da600d0d174d96aab7b188c5090857`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:46.197565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:46.262616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:46.310295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1066/2142] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:46.324159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:46.325834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:46.333897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:46.428032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36839a61-d4a3-47a3-b1b6-ba460b9eaa61 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:46.439435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35d784-0deb-4136-9b8e-1ba8fbbc5dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:46.440072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d784-0deb-4136-9b8e-1ba8fbbc5dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.440364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d784-0deb-4136-9b8e-1ba8fbbc5dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.440654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d784-0deb-4136-9b8e-1ba8fbbc5dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.457531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35d784-0deb-4136-9b8e-1ba8fbbc5dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:46.461250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35d784-0deb-4136-9b8e-1ba8fbbc5dd5 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:46.474120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1077/2143] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:46.489279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:46.489279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:46.628919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f855cd7-afea-4b8b-be74-3e660ea747e3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:46.638176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:46.639070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.639352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.639760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] PATH_INFO: `/v3/projects/cf90877937c2419992250d7a6bbb30f5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.642784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf90877937c2419992250d7a6bbb30f5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:46.646963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:46.704713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf90877937c2419992250d7a6bbb30f5', 'request_id': 'req-f7580cc9-3b52-4945-8097-7529b8e6dd65'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:46.713909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf90877937c2419992250d7a6bbb30f5', 'request_id': 'req-f7580cc9-3b52-4945-8097-7529b8e6dd65'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:46.723143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf90877937c2419992250d7a6bbb30f5', 'request_id': 'req-f7580cc9-3b52-4945-8097-7529b8e6dd65'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:46.744405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] The token cache is being invalidate because project cf90877937c2419992250d7a6bbb30f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:46.744808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:46.745593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:46.747245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1067/2144] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:46 2022] DELETE /identity/v3/projects/cf90877937c2419992250d7a6bbb30f5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:46.753526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd367e9d-9688-442a-91f4-bcc237c1b479 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.753808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd367e9d-9688-442a-91f4-bcc237c1b479 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.754161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd367e9d-9688-442a-91f4-bcc237c1b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.781926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:46.783494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:46.791764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-cd367e9d-9688-442a-91f4-bcc237c1b479 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:46.794489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cd367e9d-9688-442a-91f4-bcc237c1b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:46.896370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7580cc9-3b52-4945-8097-7529b8e6dd65 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:46.902527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1078/2145] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:46.902747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:46.903708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.904499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.904499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] PATH_INFO: `/v3/projects/1f651a29c195448d8821c779d61a8508` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.920784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba063e8-ff09-447a-a727-5d1208fac79e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:46.921077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba063e8-ff09-447a-a727-5d1208fac79e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:46.921362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba063e8-ff09-447a-a727-5d1208fac79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:46.923292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f651a29c195448d8821c779d61a8508)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:46.925928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:46.937319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:46.962622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7ba063e8-ff09-447a-a727-5d1208fac79e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:46.963744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7ba063e8-ff09-447a-a727-5d1208fac79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:46.988424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1079/2146] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:46.995498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba063e8-ff09-447a-a727-5d1208fac79e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.012302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba063e8-ff09-447a-a727-5d1208fac79e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:47.027045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:47.028011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.032301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.032613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.033460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:47.033779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:47.035535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:47.067352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1080/2147] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:47.069649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.076377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f651a29c195448d8821c779d61a8508', 'request_id': 'req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.094756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba621-ae2a-4c20-9af4-6e47cb802a67 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:47.098927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f651a29c195448d8821c779d61a8508', 'request_id': 'req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.107289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f651a29c195448d8821c779d61a8508', 'request_id': 'req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.129578 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] The token cache is being invalidate because project 1f651a29c195448d8821c779d61a8508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:47.130128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.131138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.134605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1068/2148] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:46 2022] DELETE /identity/v3/projects/1f651a29c195448d8821c779d61a8508 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:47.141513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.144536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:47.193805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:47.194684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.195073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.195972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.197761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:47.200373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:47.253365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1081/2149] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:47 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:47.255120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.257144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:47.259846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6122f-5fa8-4ba0-a6b8-44581f06bd4c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:47.284081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:47.393693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:47.394910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.395532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.396255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] PATH_INFO: `/v3/users/9d6e92d69d2846c581101552933f8697` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.398066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6e92d69d2846c581101552933f8697)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:47.400685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:47.432112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce332-684b-46ad-b7c3-e296b98d3c6f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:47.441093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:47.442145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.442660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.443135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.444265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:47.447035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:47.502284 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1082/2150] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:47 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:47.503712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.505672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:47.508089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6e92d69d2846c581101552933f8697'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.510251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6e92d69d2846c581101552933f8697'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.536170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6e92d69d2846c581101552933f8697'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.537307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcd6d6-52c5-45ac-b9cf-d040edb951ca admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:47.542323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:47.543283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.543710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.543990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.544899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:47.546708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:47.548705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6e92d69d2846c581101552933f8697'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.549610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6e92d69d2846c581101552933f8697'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:47.568428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1083/2151] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:47.573512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.579709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:47.603799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1069/2152] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:47 2022] DELETE /identity/v3/users/9d6e92d69d2846c581101552933f8697 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:47.607627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fe98-1e34-416e-a715-8a92b7b593cd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:47.742749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfeb586-401c-4ffc-8258-b27d15648645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:47.744153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeb586-401c-4ffc-8258-b27d15648645 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.744497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeb586-401c-4ffc-8258-b27d15648645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.746754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfeb586-401c-4ffc-8258-b27d15648645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.747539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfeb586-401c-4ffc-8258-b27d15648645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:47.755519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfeb586-401c-4ffc-8258-b27d15648645 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:47.788905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1084/2153] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:47.795931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.809254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca8e19-7f91-46c8-baca-bee2e4d62cef admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:47.817305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:47.818264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.818552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.818833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] PATH_INFO: `/v3/projects/40f2d41580ca461e9d5d1cc4b15f54e1/users/3baef6c0e86642f799fa8f26dc77e98d/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.838310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f2d41580ca461e9d5d1cc4b15f54e1, user_id=3baef6c0e86642f799fa8f26dc77e98d, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:47.841053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:47.869783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1070/2154] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:47 2022] PUT /identity/v3/projects/40f2d41580ca461e9d5d1cc4b15f54e1/users/3baef6c0e86642f799fa8f26dc77e98d/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:47.872409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:47.872701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:47.873101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:47.914247 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] MFA Rules not processed for user `3baef6c0e86642f799fa8f26dc77e98d`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:47.916501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:47.935481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:47.940460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.012794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1085/2155] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:48.013790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:48.015540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.038376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:48.045496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010da1b2-bba5-4137-8d68-37f15f46c15e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:48.055264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:48.056293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.056583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.056861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] PATH_INFO: `/v3/users/4fc58f7ca26240ef9c1e458dd5832a15` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.058107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc58f7ca26240ef9c1e458dd5832a15)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:48.060394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:48.099138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29679de-b8ad-4aa7-a49d-a163c2c66195 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:48.105333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:48.106654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.106968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.107394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] PATH_INFO: `/v3/projects/c886be5be65749839f73549f088f3608` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.108676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c886be5be65749839f73549f088f3608)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:48.111310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:48.120324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc58f7ca26240ef9c1e458dd5832a15'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.121974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc58f7ca26240ef9c1e458dd5832a15'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.135801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc58f7ca26240ef9c1e458dd5832a15'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.146439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc58f7ca26240ef9c1e458dd5832a15'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.147225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc58f7ca26240ef9c1e458dd5832a15'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.169269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c886be5be65749839f73549f088f3608', 'request_id': 'req-aadfa117-ff89-4b75-9d78-dad081c96313'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.174446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1071/2156] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:47 2022] DELETE /identity/v3/users/4fc58f7ca26240ef9c1e458dd5832a15 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:48.175375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:48.178591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.185343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c886be5be65749839f73549f088f3608', 'request_id': 'req-aadfa117-ff89-4b75-9d78-dad081c96313'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.200872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c886be5be65749839f73549f088f3608', 'request_id': 'req-aadfa117-ff89-4b75-9d78-dad081c96313'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.202493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:48.222081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] The token cache is being invalidate because project c886be5be65749839f73549f088f3608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:48.222442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.223445 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.225355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1086/2157] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:48 2022] DELETE /identity/v3/projects/c886be5be65749839f73549f088f3608 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:48.232500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:48.232500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.265312 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a95679-09bf-4387-861a-04b32d0857a1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:48.277354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:48.279280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.279812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.280796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.285209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.321065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfa117-ff89-4b75-9d78-dad081c96313 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:48.361641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:48.363494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:48.376511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1072/2158] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:48.388677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:48.391685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.399997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:48.412435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:48.413574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.414550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.415417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] PATH_INFO: `/v3/users/5bb3957bdc5642b5b36d4e631a6de19f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.417281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb3957bdc5642b5b36d4e631a6de19f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:48.419723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:48.481542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb3957bdc5642b5b36d4e631a6de19f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.491239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb3957bdc5642b5b36d4e631a6de19f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.491414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63add9e-9072-4f2f-9e56-fb2b09eb9f8d service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:48.492169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb3957bdc5642b5b36d4e631a6de19f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.493183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb3957bdc5642b5b36d4e631a6de19f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.497684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:48.498668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.499180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.499551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] PATH_INFO: `/v3/projects/71c833c25fd945f1ad729d66bde51100` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.501063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c833c25fd945f1ad729d66bde51100)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:48.503959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:48.505698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1ed10fdb-7721-4e8a-bc49-9ba91f17dcbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb3957bdc5642b5b36d4e631a6de19f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.528189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1087/2159] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:48 2022] DELETE /identity/v3/users/5bb3957bdc5642b5b36d4e631a6de19f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:48.580088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c833c25fd945f1ad729d66bde51100', 'request_id': 'req-760609ad-697c-4780-8eaa-21deb6635f74'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.595806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c833c25fd945f1ad729d66bde51100', 'request_id': 'req-760609ad-697c-4780-8eaa-21deb6635f74'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.604940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c833c25fd945f1ad729d66bde51100', 'request_id': 'req-760609ad-697c-4780-8eaa-21deb6635f74'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.644481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] The token cache is being invalidate because project 71c833c25fd945f1ad729d66bde51100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:48.644771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.648128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-760609ad-697c-4780-8eaa-21deb6635f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:48.657389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c253a-0b0e-4876-9ebf-cd62a6e5295e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.657683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c253a-0b0e-4876-9ebf-cd62a6e5295e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.658004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c253a-0b0e-4876-9ebf-cd62a6e5295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.660114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1073/2160] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:48 2022] DELETE /identity/v3/projects/71c833c25fd945f1ad729d66bde51100 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:48.720965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e70c253a-0b0e-4876-9ebf-cd62a6e5295e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:48.723315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e70c253a-0b0e-4876-9ebf-cd62a6e5295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.866290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1088/2161] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:48.875286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1838-2863-4637-b6f4-90be71a9a371 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.875562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1838-2863-4637-b6f4-90be71a9a371 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.875862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1838-2863-4637-b6f4-90be71a9a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.884284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:48.901809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-df0a1838-2863-4637-b6f4-90be71a9a371 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:48.903197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-df0a1838-2863-4637-b6f4-90be71a9a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:48.912225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1074/2162] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:48.916736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c253a-0b0e-4876-9ebf-cd62a6e5295e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:48.933922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c253a-0b0e-4876-9ebf-cd62a6e5295e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:48.941085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:48.941908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.942195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.942468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.943528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:48.943880 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:48.948191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:48.964174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1089/2163] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:48.968707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a1838-2863-4637-b6f4-90be71a9a371 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:48.978682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a1838-2863-4637-b6f4-90be71a9a371 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:48.983600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:48.984296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:48.984581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:48.984857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:48.985554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:48.987488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.017269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1075/2164] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:48 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:49.020707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.047487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb04de-2a76-4d35-a526-0cf605836c4b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.105745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.106422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.106707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.106987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.107715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.109657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.117267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:49.136883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.137872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1090/2165] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:49 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:49.147618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4934f-6d39-4d77-9313-a1f8aef39cdc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.154878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.154878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.154878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.154878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.155685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.156555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.157124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.158268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:49.170603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1076/2166] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:49.172654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401912-6482-4254-baf1-afd81dcfa537 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.174601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.178023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.178898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.179193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.179489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] PATH_INFO: `/v3/projects/ffe7a64863a4430cba8a4e8001a2f1d8` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.181243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe7a64863a4430cba8a4e8001a2f1d8)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.183209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.186299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f039d-733d-4e6c-9f31-ae49ca912859 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.194205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.194205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.194205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.194205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.194767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.197313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.211260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1077/2167] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:49.215442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.227413 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4bd12-6651-4f27-bc4f-37eb74e81e1d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.239113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe7a64863a4430cba8a4e8001a2f1d8', 'request_id': 'req-22e1e221-9268-4d22-adff-39e9415cd60f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.246731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe7a64863a4430cba8a4e8001a2f1d8', 'request_id': 'req-22e1e221-9268-4d22-adff-39e9415cd60f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.252811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe7a64863a4430cba8a4e8001a2f1d8', 'request_id': 'req-22e1e221-9268-4d22-adff-39e9415cd60f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.266492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] The token cache is being invalidate because project ffe7a64863a4430cba8a4e8001a2f1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:49.267023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.267751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.269563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1091/2168] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:49 2022] DELETE /identity/v3/projects/ffe7a64863a4430cba8a4e8001a2f1d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:49.294784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81fc19-d495-49d4-b4da-34e9912fa8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.295853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fc19-d495-49d4-b4da-34e9912fa8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.296216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fc19-d495-49d4-b4da-34e9912fa8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.296722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fc19-d495-49d4-b4da-34e9912fa8f5 admin admin] PATH_INFO: `/v3/projects/da5b0ff69fa74d148dafb88c9ac401ee/users/2b49aad9b4a941b5aadbf2d5a56c7f44/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.306146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.308666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:49.320807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81fc19-d495-49d4-b4da-34e9912fa8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5b0ff69fa74d148dafb88c9ac401ee, user_id=2b49aad9b4a941b5aadbf2d5a56c7f44, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.324460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81fc19-d495-49d4-b4da-34e9912fa8f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.324753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1e221-9268-4d22-adff-39e9415cd60f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.330138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.331096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.331368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.331705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] PATH_INFO: `/v3/users/43da600d0d174d96aab7b188c5090857` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.332961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43da600d0d174d96aab7b188c5090857)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.335248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.344570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1078/2169] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:49 2022] PUT /identity/v3/projects/da5b0ff69fa74d148dafb88c9ac401ee/users/2b49aad9b4a941b5aadbf2d5a56c7f44/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:49.354593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.354903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.355164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.385925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] MFA Rules not processed for user `2b49aad9b4a941b5aadbf2d5a56c7f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:49.387190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:49.402580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43da600d0d174d96aab7b188c5090857'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.413397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43da600d0d174d96aab7b188c5090857'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.414120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43da600d0d174d96aab7b188c5090857'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.414862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43da600d0d174d96aab7b188c5090857'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.427089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-adcdd1ed-2566-4b03-8eb4-7cf1fdd8c2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43da600d0d174d96aab7b188c5090857'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:49.451481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1092/2170] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:49 2022] DELETE /identity/v3/users/43da600d0d174d96aab7b188c5090857 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:49.456356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.456786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.457167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.473419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1079/2171] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:49.474358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.475885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:49.482953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:49.484304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:49.505707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:49.528103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:INSERT=4,keystone:SELECT=79,keystone:DELETE=17 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:49.547116 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4422f-1524-4d83-b644-6b13e6914529 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.547693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1093/2172] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:49.552110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.552787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.553077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.553359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.554058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.556575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.558551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.559982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:49.587882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1080/2173] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:49 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:49.591806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.621073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c023115-1826-4ea5-b887-62b41ea01a78 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.662671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070c08-54f1-46a6-9963-318fe63b5be6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.669150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.669893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.670181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.670463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.671170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.672701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.673155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.673349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.673628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.674024 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.685264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.686735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.696900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1094/2174] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:49.698148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1081/2175] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:49 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:49.701987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.711892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f0c49-13ae-4b38-9340-e42fe0b09215 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.716827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.717830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.718110 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.718529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.719270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.720947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.732014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1095/2176] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:49.736584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.749075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9d16-c3f8-4bc5-adb9-996be5ae2c12 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.754160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.755055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.755343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.755657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] PATH_INFO: `/v3/projects/10a02a02fa5b4d888b57313de8202ace/users/22668cc106e5482282123bd50990d85f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.771999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a02a02fa5b4d888b57313de8202ace, user_id=22668cc106e5482282123bd50990d85f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.775330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.789740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1082/2177] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:49 2022] PUT /identity/v3/projects/10a02a02fa5b4d888b57313de8202ace/users/22668cc106e5482282123bd50990d85f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:49.794228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.808308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962548-2a24-4702-972f-afb609a8b70e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.904874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9ecac-aa7d-414f-9a3c-ce47763c77bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.907964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ecac-aa7d-414f-9a3c-ce47763c77bf admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.908527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ecac-aa7d-414f-9a3c-ce47763c77bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.909060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ecac-aa7d-414f-9a3c-ce47763c77bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.909960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9ecac-aa7d-414f-9a3c-ce47763c77bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.913216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9ecac-aa7d-414f-9a3c-ce47763c77bf admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:49.954108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1096/2178] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:49.960317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:49.986893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcc04c-7fa2-4d93-ace3-43a6450f1823 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:49.992508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:49.993451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:49.993738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:49.994018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] PATH_INFO: `/v3/projects/10a02a02fa5b4d888b57313de8202ace/users/22668cc106e5482282123bd50990d85f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:49.996090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a02a02fa5b4d888b57313de8202ace, user_id=22668cc106e5482282123bd50990d85f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:49.998773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.014300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1083/2179] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:49 2022] PUT /identity/v3/projects/10a02a02fa5b4d888b57313de8202ace/users/22668cc106e5482282123bd50990d85f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:50.024017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.025222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.025506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.065938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.068712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.085688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] MFA Rules not processed for user `22668cc106e5482282123bd50990d85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:50.089449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.135706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:50.172082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94af36-a18b-43af-8670-418cde4fd1ec admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.186846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.187887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.188326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.188687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] PATH_INFO: `/v3/projects/a2edfd7037ce47f5a3fd50f4725265a7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.189977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2edfd7037ce47f5a3fd50f4725265a7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.192057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.194870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:50.204619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1097/2180] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:50.218955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.220545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.265071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2edfd7037ce47f5a3fd50f4725265a7', 'request_id': 'req-3de243e5-5d4a-4da2-a975-314d9e86940c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:50.282161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2edfd7037ce47f5a3fd50f4725265a7', 'request_id': 'req-3de243e5-5d4a-4da2-a975-314d9e86940c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:50.289687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2edfd7037ce47f5a3fd50f4725265a7', 'request_id': 'req-3de243e5-5d4a-4da2-a975-314d9e86940c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:50.295291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca43f4-8d2c-40e2-b81d-9f93017e4d17 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.304077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] The token cache is being invalidate because project a2edfd7037ce47f5a3fd50f4725265a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:50.304498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:50.305457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3de243e5-5d4a-4da2-a975-314d9e86940c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:50.307526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1084/2181] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:50 2022] DELETE /identity/v3/projects/a2edfd7037ce47f5a3fd50f4725265a7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:50.318008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb709d1-a8ac-4c71-9701-7ee92cdb7e1f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.318441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb709d1-a8ac-4c71-9701-7ee92cdb7e1f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.319152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb709d1-a8ac-4c71-9701-7ee92cdb7e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.341070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6fb709d1-a8ac-4c71-9701-7ee92cdb7e1f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:50.342583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6fb709d1-a8ac-4c71-9701-7ee92cdb7e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.358699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.359956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.360627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.360913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.363481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.415320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1085/2182] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:50.423994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce0ef5-e112-4925-8233-9d9a8d030318 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.424290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce0ef5-e112-4925-8233-9d9a8d030318 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.424632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce0ef5-e112-4925-8233-9d9a8d030318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.443697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.445492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.449529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c6ce0ef5-e112-4925-8233-9d9a8d030318 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:50.451333 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c6ce0ef5-e112-4925-8233-9d9a8d030318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.457689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1098/2183] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:10:50.460120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1086/2184] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:50.465666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.482372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e1be5-7811-4ae9-946f-738657eb79dd service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.490866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.491875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.492314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.492716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.493600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:50.494010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.496066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.515400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1099/2185] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:50.519247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce0ef5-e112-4925-8233-9d9a8d030318 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.529995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce0ef5-e112-4925-8233-9d9a8d030318 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.535945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.536604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.536888 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.539661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.539661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.543635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.585684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1087/2186] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:50 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:50.586755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.598103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420039f3-0718-4929-aa47-77184e96b7ec admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.606588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:50.671126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.671841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.672132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.672413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.673125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.675245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.704103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1100/2187] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:50 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:50.709123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.721531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a100-5f56-496a-aeb2-b098f48ba75e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.727557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.728319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.728634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.728971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.729645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.731231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.742553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1088/2188] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:50.747147 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.757718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a6bb-2e15-4223-a27b-d507a83fb9a7 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.763678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e7eec-24ba-410b-b8b9-a64eb83f26c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.764349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e7eec-24ba-410b-b8b9-a64eb83f26c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.764636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e7eec-24ba-410b-b8b9-a64eb83f26c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.764916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e7eec-24ba-410b-b8b9-a64eb83f26c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.765647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e7eec-24ba-410b-b8b9-a64eb83f26c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.767256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e7eec-24ba-410b-b8b9-a64eb83f26c7 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.778558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1101/2189] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:50.782900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.794910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8046-d605-44ae-9cec-52c4aa19aaf9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:50.799774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:50.800664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.800955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.801229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] PATH_INFO: `/v3/projects/5c363b832d3c4e708a517ff0d3e57915/users/aee723bd75de444a92ec1032e8fb55ce/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.817209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c363b832d3c4e708a517ff0d3e57915, user_id=aee723bd75de444a92ec1032e8fb55ce, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:50.820192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:50.834012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1089/2190] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:50 2022] PUT /identity/v3/projects/5c363b832d3c4e708a517ff0d3e57915/users/aee723bd75de444a92ec1032e8fb55ce/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:50.844391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:50.844688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:50.844972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:50.873820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] MFA Rules not processed for user `aee723bd75de444a92ec1032e8fb55ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:50.874901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.943718 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.945433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.950727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1102/2191] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:50.965471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:50.967276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:50.985743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:51.029307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37745-96f2-48d2-8132-fc9f215c2418 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:51.030657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef6392-6671-4651-ab04-180dc67312a4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:51.034391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325892ef-220a-4d30-90b5-868ac1cc76f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:51.034525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:51.035069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325892ef-220a-4d30-90b5-868ac1cc76f7 service glance] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:51.035348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325892ef-220a-4d30-90b5-868ac1cc76f7 service glance] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:51.035457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:51.035650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325892ef-220a-4d30-90b5-868ac1cc76f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:51.035747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:51.036001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] PATH_INFO: `/v3/users/2b49aad9b4a941b5aadbf2d5a56c7f44` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:51.037254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b49aad9b4a941b5aadbf2d5a56c7f44)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:51.039255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:51.045141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325892ef-220a-4d30-90b5-868ac1cc76f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:51.047034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325892ef-220a-4d30-90b5-868ac1cc76f7 service glance] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:51.057580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1103/2192] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:51.095344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b49aad9b4a941b5aadbf2d5a56c7f44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.096042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b49aad9b4a941b5aadbf2d5a56c7f44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.104104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b49aad9b4a941b5aadbf2d5a56c7f44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.113449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b49aad9b4a941b5aadbf2d5a56c7f44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.114172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b49aad9b4a941b5aadbf2d5a56c7f44'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.133863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1090/2193] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:50 2022] DELETE /identity/v3/users/2b49aad9b4a941b5aadbf2d5a56c7f44 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:51.138259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:51.138556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:51.138839 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:51.159360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:51.160643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:51.174749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:51.227202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1104/2194] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:51.237843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:51.239255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:51.314148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b84eb-cf0c-4abc-849c-00be964d1f8c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:51.321363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:51.322816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:51.323179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:51.323529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:51.335170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:51.337261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:51.350502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1091/2195] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:51.697032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:51.698677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:51.729035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05814a32-2d8b-42d8-8364-7fdd58d3659a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:51.734177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:51.735205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:51.735522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:51.735828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] PATH_INFO: `/v3/projects/da5b0ff69fa74d148dafb88c9ac401ee` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:51.737040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5b0ff69fa74d148dafb88c9ac401ee)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:51.738978 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:51.796146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5b0ff69fa74d148dafb88c9ac401ee', 'request_id': 'req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.802441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5b0ff69fa74d148dafb88c9ac401ee', 'request_id': 'req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.808449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5b0ff69fa74d148dafb88c9ac401ee', 'request_id': 'req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.820701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] The token cache is being invalidate because project da5b0ff69fa74d148dafb88c9ac401ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:51.821003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.822219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.823851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1105/2196] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:51 2022] DELETE /identity/v3/projects/da5b0ff69fa74d148dafb88c9ac401ee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:51.827979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:51.838485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47c1cb-a546-4abe-920d-1d6f4c64df1a service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:51.888396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:51.901287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:51.902234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:51.902591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:51.902876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] PATH_INFO: `/v3/users/22668cc106e5482282123bd50990d85f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:51.904141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22668cc106e5482282123bd50990d85f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:51.906392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:51.956635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22668cc106e5482282123bd50990d85f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.957407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22668cc106e5482282123bd50990d85f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.965604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22668cc106e5482282123bd50990d85f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.974654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22668cc106e5482282123bd50990d85f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.975373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4fdd81ec-901c-466f-b965-e3d8ad875de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22668cc106e5482282123bd50990d85f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:51.992721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1092/2197] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:51 2022] DELETE /identity/v3/users/22668cc106e5482282123bd50990d85f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:52.283508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:52.285036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:52.301003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3cabb-f7c3-469e-9c1b-7906922b39f6 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:52.363394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:52.364547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.364939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.365278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] PATH_INFO: `/v3/projects/10a02a02fa5b4d888b57313de8202ace` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.366804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a02a02fa5b4d888b57313de8202ace)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:52.369713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:52.418244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:52.421953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a02a02fa5b4d888b57313de8202ace', 'request_id': 'req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:52.432421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a02a02fa5b4d888b57313de8202ace', 'request_id': 'req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:52.438169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a02a02fa5b4d888b57313de8202ace', 'request_id': 'req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:52.450381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] The token cache is being invalidate because project 10a02a02fa5b4d888b57313de8202ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:52.450666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:52.451269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2b45a4f9-f8c0-483d-93b7-5acbd586f36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:52.452946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1106/2198] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:52 2022] DELETE /identity/v3/projects/10a02a02fa5b4d888b57313de8202ace => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:52.458059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5c2ff-9f2e-4c55-9bca-50d2bd46724c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.458486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5c2ff-9f2e-4c55-9bca-50d2bd46724c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.458844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5c2ff-9f2e-4c55-9bca-50d2bd46724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.479466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-98f5c2ff-9f2e-4c55-9bca-50d2bd46724c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:52.480763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-98f5c2ff-9f2e-4c55-9bca-50d2bd46724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:52.544166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1093/2199] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:52.553152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3582-6648-401b-b3a0-c396b4965f77 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.553478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3582-6648-401b-b3a0-c396b4965f77 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.553767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3582-6648-401b-b3a0-c396b4965f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.581036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-caae3582-6648-401b-b3a0-c396b4965f77 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:52.582264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-caae3582-6648-401b-b3a0-c396b4965f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:52.590662 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1107/2200] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:52.594860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5c2ff-9f2e-4c55-9bca-50d2bd46724c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:52.605764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5c2ff-9f2e-4c55-9bca-50d2bd46724c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:52.610987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:52.611728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.612018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.612299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.613073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:52.613465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:52.615129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:52.629650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1094/2201] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:52.634103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae3582-6648-401b-b3a0-c396b4965f77 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:52.644652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae3582-6648-401b-b3a0-c396b4965f77 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:52.650281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:52.650956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.651272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.651551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.652465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:52.657919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:52.690338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1108/2202] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:52 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:52.695886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:52.706163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e8848-8492-4c68-975f-bd2f8d92d87e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:52.760546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:52.768380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:52.769118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.769565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.769851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.770625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:52.773394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:52.796642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1095/2203] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:52 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:52.800311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:52.811236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bace2-2365-4fe6-bed8-a592e0faaeb5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:52.817215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:52.819675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.819675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.819675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.819675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:52.821579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:52.839451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1109/2204] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:52.840751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:52.850834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bcb9f-b56e-4fa4-a206-ca29d976538f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:52.856738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3a605-09e3-403c-ab19-e9872878a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:52.857648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3a605-09e3-403c-ab19-e9872878a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.857936 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3a605-09e3-403c-ab19-e9872878a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.858349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3a605-09e3-403c-ab19-e9872878a5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.859253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3a605-09e3-403c-ab19-e9872878a5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:52.860946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3a605-09e3-403c-ab19-e9872878a5aa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:52.872656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1096/2205] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:52.880344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:52.890845 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee965a9-e257-455d-87c4-51bb80891529 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:52.896146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:52.897072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.897409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.897742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] PATH_INFO: `/v3/projects/c1947644a5384aa7b57cffe35e53f81e/users/6656ca27b46c44f3ac34e8c3eacfe32a/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.917193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1947644a5384aa7b57cffe35e53f81e, user_id=6656ca27b46c44f3ac34e8c3eacfe32a, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:52.919971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:52.945797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1110/2206] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:52 2022] PUT /identity/v3/projects/c1947644a5384aa7b57cffe35e53f81e/users/6656ca27b46c44f3ac34e8c3eacfe32a/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:52.959040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe9e2f-a7d0-4e3c-9eca-97fc618fc56e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:52.959335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe9e2f-a7d0-4e3c-9eca-97fc618fc56e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:52.959660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe9e2f-a7d0-4e3c-9eca-97fc618fc56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:52.988608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-06fe9e2f-a7d0-4e3c-9eca-97fc618fc56e None None] MFA Rules not processed for user `6656ca27b46c44f3ac34e8c3eacfe32a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:52.989840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-06fe9e2f-a7d0-4e3c-9eca-97fc618fc56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:53.055265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1097/2207] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:53.059803 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.127648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ee64-3387-472e-bf3d-e726e157a3a6 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.133254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.134469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.134786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.135021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.135815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.137915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.167275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1111/2208] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:53 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:53.171370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe9e2f-a7d0-4e3c-9eca-97fc618fc56e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.183438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe9e2f-a7d0-4e3c-9eca-97fc618fc56e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.243476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.244193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.244479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.244758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.245471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.247416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.272114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1098/2209] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:53 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:53.273417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.287794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264c0d-a9d2-483e-af79-d8f69996b586 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.292681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.293354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.293641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.293921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.294661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.296672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.307964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1112/2210] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:53.312097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.325485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20aba3-9542-4536-b856-980d0162db74 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.330255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.331152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.331433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.331739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] PATH_INFO: `/v3/projects/a9f8c4903a854767bdeab57bf4f6a2f7/users/e0bc658c98c14a01924ae5f882653cf7/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.348703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f8c4903a854767bdeab57bf4f6a2f7, user_id=e0bc658c98c14a01924ae5f882653cf7, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.351351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.364678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1099/2211] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:53 2022] PUT /identity/v3/projects/a9f8c4903a854767bdeab57bf4f6a2f7/users/e0bc658c98c14a01924ae5f882653cf7/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:10:53.368689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.379299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ef9f-a19b-41c4-a24c-ebcc9ff9c44e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.424219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:53.442066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b173e9-aee9-455e-9e26-2a6357de0c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.442776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b173e9-aee9-455e-9e26-2a6357de0c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.443058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b173e9-aee9-455e-9e26-2a6357de0c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.443334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b173e9-aee9-455e-9e26-2a6357de0c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.444113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b173e9-aee9-455e-9e26-2a6357de0c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.445721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b173e9-aee9-455e-9e26-2a6357de0c06 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.456623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1113/2212] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:53.460740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.472129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c988c-5613-4186-a697-de59820d5e48 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.477448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.478344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.478627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.478901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] PATH_INFO: `/v3/projects/a9f8c4903a854767bdeab57bf4f6a2f7/users/e0bc658c98c14a01924ae5f882653cf7/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.480925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f8c4903a854767bdeab57bf4f6a2f7, user_id=e0bc658c98c14a01924ae5f882653cf7, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.483540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.495164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1100/2213] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:53 2022] PUT /identity/v3/projects/a9f8c4903a854767bdeab57bf4f6a2f7/users/e0bc658c98c14a01924ae5f882653cf7/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:53.505430 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1686bdf-0a86-407d-988c-910bc1fb6c59 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.505753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1686bdf-0a86-407d-988c-910bc1fb6c59 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.506033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1686bdf-0a86-407d-988c-910bc1fb6c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.535372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c1686bdf-0a86-407d-988c-910bc1fb6c59 None None] MFA Rules not processed for user `e0bc658c98c14a01924ae5f882653cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:53.536646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c1686bdf-0a86-407d-988c-910bc1fb6c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:53.606552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1114/2214] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:53.618609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.620682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:53.642321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:53.682230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2678e-1830-4f32-b7ac-226d90415a7c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.686249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385e6e3-65a1-4ecc-8bbc-975969a36020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.686689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6e3-65a1-4ecc-8bbc-975969a36020 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.686970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6e3-65a1-4ecc-8bbc-975969a36020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.687247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385e6e3-65a1-4ecc-8bbc-975969a36020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.698508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385e6e3-65a1-4ecc-8bbc-975969a36020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.700862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385e6e3-65a1-4ecc-8bbc-975969a36020 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.711263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1101/2215] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:53.806166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1686bdf-0a86-407d-988c-910bc1fb6c59 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:53.872721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1686bdf-0a86-407d-988c-910bc1fb6c59 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:53.877337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:53.878216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.878537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.878776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] PATH_INFO: `/v3/users/6656ca27b46c44f3ac34e8c3eacfe32a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:53.880007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6656ca27b46c44f3ac34e8c3eacfe32a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:53.881940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:53.933609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6656ca27b46c44f3ac34e8c3eacfe32a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:53.942517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6656ca27b46c44f3ac34e8c3eacfe32a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:53.943186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6656ca27b46c44f3ac34e8c3eacfe32a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:53.943848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6656ca27b46c44f3ac34e8c3eacfe32a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:53.957178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6656ca27b46c44f3ac34e8c3eacfe32a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:53.962654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:53.983814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1115/2216] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:53 2022] DELETE /identity/v3/users/6656ca27b46c44f3ac34e8c3eacfe32a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:53.988873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:53.989412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:53.989508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:54.007816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:54.009032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:54.081197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1102/2217] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:54.091599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:54.093342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:54.165822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204faaf6-af03-48d0-85ef-202058b75ed4 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:54.171156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:54.172200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:54.172406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:54.172697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:54.196998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:54.198467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:54.210025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1116/2218] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:54.513040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:54.514471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:54.528035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f929-9434-4d84-9a9b-7062850cdf3a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:54.533068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:54.533951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:54.534283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:54.534562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] PATH_INFO: `/v3/projects/c1947644a5384aa7b57cffe35e53f81e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:54.535816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1947644a5384aa7b57cffe35e53f81e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:54.537741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:54.598147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1947644a5384aa7b57cffe35e53f81e', 'request_id': 'req-af73ba25-62dc-4bf2-8c8e-f0e065298975'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.608316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1947644a5384aa7b57cffe35e53f81e', 'request_id': 'req-af73ba25-62dc-4bf2-8c8e-f0e065298975'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.614370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1947644a5384aa7b57cffe35e53f81e', 'request_id': 'req-af73ba25-62dc-4bf2-8c8e-f0e065298975'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.626079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] The token cache is being invalidate because project c1947644a5384aa7b57cffe35e53f81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:54.626371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.627011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.628604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1103/2219] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:54 2022] DELETE /identity/v3/projects/c1947644a5384aa7b57cffe35e53f81e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:54.632599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:54.643515 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173221c0-0311-4728-888c-e34d2ea95007 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:54.702838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:54.703680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:54.703967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:54.704245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] PATH_INFO: `/v3/users/e0bc658c98c14a01924ae5f882653cf7` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:54.705463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0bc658c98c14a01924ae5f882653cf7)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:54.707422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:54.763862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0bc658c98c14a01924ae5f882653cf7'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.771811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0bc658c98c14a01924ae5f882653cf7'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.772431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0bc658c98c14a01924ae5f882653cf7'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.773039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0bc658c98c14a01924ae5f882653cf7'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.780890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-16e28d2c-f668-4de3-a1be-dade1712a8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0bc658c98c14a01924ae5f882653cf7'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:54.801649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1117/2220] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:54 2022] DELETE /identity/v3/users/e0bc658c98c14a01924ae5f882653cf7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:55.128205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:55.129648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:55.146438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ba25-62dc-4bf2-8c8e-f0e065298975 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:55.197844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:55.218666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:55.219641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.220013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.220347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] PATH_INFO: `/v3/projects/a9f8c4903a854767bdeab57bf4f6a2f7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.221594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f8c4903a854767bdeab57bf4f6a2f7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:55.223594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:55.281015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f8c4903a854767bdeab57bf4f6a2f7', 'request_id': 'req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:55.288840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f8c4903a854767bdeab57bf4f6a2f7', 'request_id': 'req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:55.299981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f8c4903a854767bdeab57bf4f6a2f7', 'request_id': 'req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:55.311539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] The token cache is being invalidate because project a9f8c4903a854767bdeab57bf4f6a2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:10:55.311855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:55.312686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4caf1cd1-acf2-4f3d-b309-d89b94cf1cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:55.316061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1104/2221] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:10:55 2022] DELETE /identity/v3/projects/a9f8c4903a854767bdeab57bf4f6a2f7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:55.323176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d0b6-a9c3-4421-8214-5be53b721d60 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.323820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d0b6-a9c3-4421-8214-5be53b721d60 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.323957 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d0b6-a9c3-4421-8214-5be53b721d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.339457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:55.346979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1028d0b6-a9c3-4421-8214-5be53b721d60 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:55.348865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1028d0b6-a9c3-4421-8214-5be53b721d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:55.427205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1118/2222] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:55.436096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e227-83e9-4eb2-9aff-9b779de59a23 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.436389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e227-83e9-4eb2-9aff-9b779de59a23 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.436673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e227-83e9-4eb2-9aff-9b779de59a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.457878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ed72e227-83e9-4eb2-9aff-9b779de59a23 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:55.459204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ed72e227-83e9-4eb2-9aff-9b779de59a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:55.471133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1105/2223] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:55.475867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d0b6-a9c3-4421-8214-5be53b721d60 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:55.487964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d0b6-a9c3-4421-8214-5be53b721d60 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:55.493448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:55.494204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.494552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.494899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.495753 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:10:55.496142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:55.498012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:55.511261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1119/2224] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:10:55.515842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e227-83e9-4eb2-9aff-9b779de59a23 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:55.527806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e227-83e9-4eb2-9aff-9b779de59a23 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:55.533741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:55.534391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.534686 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.534968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.535879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:55.537851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:55.570134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1106/2225] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:55 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:55.574356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:55.590048 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef6e5-cdff-4b69-a2b0-2a0a7e9dc230 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:55.673898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:55.674818 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.675191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.675531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.676350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:55.678429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:55.699538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1120/2226] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:55 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:10:55.703516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:55.714183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02aaad-0729-46a5-b226-0b12dfd9e1b5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:55.719421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:55.720185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.720492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.720943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.721673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:55.723353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:55.737667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1107/2227] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:55.741706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:55.752729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14998197-b465-45de-ade9-4b1eb1544e45 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:55.757778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab133a-d0a1-4389-bac1-133b3f9d9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:55.758433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab133a-d0a1-4389-bac1-133b3f9d9554 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.758719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab133a-d0a1-4389-bac1-133b3f9d9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.758997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab133a-d0a1-4389-bac1-133b3f9d9554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.759817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab133a-d0a1-4389-bac1-133b3f9d9554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:55.761690 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab133a-d0a1-4389-bac1-133b3f9d9554 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:55.776759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1121/2228] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:10:55.780641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:55.791310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758adf-4685-454b-ae7e-c5f4e17f4b35 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:55.795918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:55.796807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.797089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.797363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] PATH_INFO: `/v3/projects/b7982fe6994843deba10b1d40ba9039d/users/33244408cf614134930c1289fd4fc86b/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.818130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7982fe6994843deba10b1d40ba9039d, user_id=33244408cf614134930c1289fd4fc86b, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:55.821777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:55.838360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1108/2229] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:55 2022] PUT /identity/v3/projects/b7982fe6994843deba10b1d40ba9039d/users/33244408cf614134930c1289fd4fc86b/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:55.848980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288ea8-4ec0-4d9c-8666-8b679318a704 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:55.849362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288ea8-4ec0-4d9c-8666-8b679318a704 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:55.849648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288ea8-4ec0-4d9c-8666-8b679318a704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:55.884047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ac288ea8-4ec0-4d9c-8666-8b679318a704 None None] MFA Rules not processed for user `33244408cf614134930c1289fd4fc86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:55.885287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ac288ea8-4ec0-4d9c-8666-8b679318a704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:55.952201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1122/2230] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:55.956789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.022544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31b72-77de-4da5-897a-1c6223345bca admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.027767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.028434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.028715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.029004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.029706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.031872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.046440 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:56.060881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1109/2231] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:10:55 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:56.065794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac288ea8-4ec0-4d9c-8666-8b679318a704 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.071523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:56.079805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac288ea8-4ec0-4d9c-8666-8b679318a704 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.151685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.152388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.152673 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.152950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.153676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.155877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.175834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1123/2232] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:10:56 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:10:56.180550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.198865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6b8ca-65b9-4b63-b941-443eafbb29b4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.203533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.204231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.204519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.204799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.205537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.207138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.219826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1110/2233] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:56.224316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.234879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dab18-1f68-41aa-902b-7fae775657bd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.240127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.241014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.241295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.241594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] PATH_INFO: `/v3/projects/74464414c4d541d9a8d7afc4eba55697/users/2bb13bf11b1f4bfa963fd6d7d6efad80/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.257406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74464414c4d541d9a8d7afc4eba55697, user_id=2bb13bf11b1f4bfa963fd6d7d6efad80, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.260701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.280433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1124/2234] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:56 2022] PUT /identity/v3/projects/74464414c4d541d9a8d7afc4eba55697/users/2bb13bf11b1f4bfa963fd6d7d6efad80/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:56.287749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.296878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713f25f-40f5-47f5-8fbd-2eaaf5315211 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.357154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd167308-e57f-44f9-a30b-10c2ecc96abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.357837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd167308-e57f-44f9-a30b-10c2ecc96abb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.358127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd167308-e57f-44f9-a30b-10c2ecc96abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.358410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd167308-e57f-44f9-a30b-10c2ecc96abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.359156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd167308-e57f-44f9-a30b-10c2ecc96abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.360815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd167308-e57f-44f9-a30b-10c2ecc96abb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.371458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1111/2235] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:10:56.375752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.386578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57b60a-9ac2-4615-8040-70eb4b4cc76a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.391330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.392316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.392582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.392861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] PATH_INFO: `/v3/projects/74464414c4d541d9a8d7afc4eba55697/users/2bb13bf11b1f4bfa963fd6d7d6efad80/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.394989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74464414c4d541d9a8d7afc4eba55697, user_id=2bb13bf11b1f4bfa963fd6d7d6efad80, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.397786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.409607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1125/2236] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:10:56 2022] PUT /identity/v3/projects/74464414c4d541d9a8d7afc4eba55697/users/2bb13bf11b1f4bfa963fd6d7d6efad80/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:56.421104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.421406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.421701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.450093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] MFA Rules not processed for user `2bb13bf11b1f4bfa963fd6d7d6efad80`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:56.451339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:56.522232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1112/2237] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:10:56.533782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.535546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:56.594310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9f95f-188c-4c5c-8836-980c180fa7f4 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.598106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.598869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.599196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.599790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.609373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.610819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.621241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1126/2238] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:56.720712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:56.722114 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:56.735246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe720e-01d8-45ec-bbe8-e261cc3eaafa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:56.742491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77809358-51bc-4a67-84c4-69534e96feb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:56.743747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77809358-51bc-4a67-84c4-69534e96feb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:56.744036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77809358-51bc-4a67-84c4-69534e96feb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:56.744317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77809358-51bc-4a67-84c4-69534e96feb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:56.814996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77809358-51bc-4a67-84c4-69534e96feb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:56.816541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77809358-51bc-4a67-84c4-69534e96feb2 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:56.826972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1113/2239] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:10:59.489436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:59.551337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:59.556863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c1623-ea0d-4a49-aaae-0bd272a34163 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:59.568157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:59.569127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:59.569540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:59.569899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] PATH_INFO: `/v3/users/33244408cf614134930c1289fd4fc86b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:59.571271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33244408cf614134930c1289fd4fc86b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:59.573375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:59.628225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33244408cf614134930c1289fd4fc86b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:59.636442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33244408cf614134930c1289fd4fc86b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:59.637154 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33244408cf614134930c1289fd4fc86b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:59.637764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33244408cf614134930c1289fd4fc86b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:59.644885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33244408cf614134930c1289fd4fc86b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:10:59.667098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1127/2240] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:10:59 2022] DELETE /identity/v3/users/33244408cf614134930c1289fd4fc86b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:10:59.672790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:59.673297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:59.673297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:59.681187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:10:59.698158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:10:59.703363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:59.773522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1114/2241] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:10:59.783840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:10:59.785274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:10:59.844801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf8fbb-7b79-42ce-9325-fc547aeff983 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:10:59.848494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:10:59.849156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:10:59.849439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:10:59.849715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:10:59.859967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:10:59.861406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:10:59.871652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1128/2242] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:00.154253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:00.156318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:00.169165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7f5a-1508-4e2f-b950-dc431999ccd4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:00.173889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:00.174885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:00.175210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:00.175641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] PATH_INFO: `/v3/projects/b7982fe6994843deba10b1d40ba9039d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:00.177153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7982fe6994843deba10b1d40ba9039d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:00.179271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:00.230929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7982fe6994843deba10b1d40ba9039d', 'request_id': 'req-9b4be300-bc4a-44da-84e1-07ffe75e59d1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.238271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7982fe6994843deba10b1d40ba9039d', 'request_id': 'req-9b4be300-bc4a-44da-84e1-07ffe75e59d1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.244021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7982fe6994843deba10b1d40ba9039d', 'request_id': 'req-9b4be300-bc4a-44da-84e1-07ffe75e59d1'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.255424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] The token cache is being invalidate because project b7982fe6994843deba10b1d40ba9039d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:00.255747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.256383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.257936 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1115/2243] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:00 2022] DELETE /identity/v3/projects/b7982fe6994843deba10b1d40ba9039d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:00.263565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:00.273631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7146a-de3d-48ab-afbb-a09942d55140 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:00.333833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:00.334704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:00.334984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:00.335255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] PATH_INFO: `/v3/users/2bb13bf11b1f4bfa963fd6d7d6efad80` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:00.336500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb13bf11b1f4bfa963fd6d7d6efad80)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:00.338781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:00.360875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:00.387743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb13bf11b1f4bfa963fd6d7d6efad80'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.395257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb13bf11b1f4bfa963fd6d7d6efad80'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.396125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb13bf11b1f4bfa963fd6d7d6efad80'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.397035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb13bf11b1f4bfa963fd6d7d6efad80'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.404018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a4797cd5-fd15-467d-ac1f-4bc2e375d969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb13bf11b1f4bfa963fd6d7d6efad80'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.424115 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1129/2244] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:11:00 2022] DELETE /identity/v3/users/2bb13bf11b1f4bfa963fd6d7d6efad80 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:00.721494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:00.723819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:00.738659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be300-bc4a-44da-84e1-07ffe75e59d1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:00.826932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:00.832108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:00.832405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:00.832693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] PATH_INFO: `/v3/projects/74464414c4d541d9a8d7afc4eba55697` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:00.835613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74464414c4d541d9a8d7afc4eba55697)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:00.843436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:00.900739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:00.916991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74464414c4d541d9a8d7afc4eba55697', 'request_id': 'req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.926962 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74464414c4d541d9a8d7afc4eba55697', 'request_id': 'req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.935823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74464414c4d541d9a8d7afc4eba55697', 'request_id': 'req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.949702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] The token cache is being invalidate because project 74464414c4d541d9a8d7afc4eba55697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:00.950074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.951335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c874e3c-59ec-4f9c-89da-496ae89d9ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:00.953296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1116/2245] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:00 2022] DELETE /identity/v3/projects/74464414c4d541d9a8d7afc4eba55697 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:00.957940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807e8d6-add3-4250-a8ec-810e82192de5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:00.958421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807e8d6-add3-4250-a8ec-810e82192de5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:00.959228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807e8d6-add3-4250-a8ec-810e82192de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:00.980591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3807e8d6-add3-4250-a8ec-810e82192de5 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:00.981830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3807e8d6-add3-4250-a8ec-810e82192de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:01.056120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1130/2246] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:01.064147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcc0a-1927-4a1d-9193-81f94953d73c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.065029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcc0a-1927-4a1d-9193-81f94953d73c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.065404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bcc0a-1927-4a1d-9193-81f94953d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.088616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-413bcc0a-1927-4a1d-9193-81f94953d73c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:01.089841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-413bcc0a-1927-4a1d-9193-81f94953d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:01.100175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1117/2247] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:01.105079 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807e8d6-add3-4250-a8ec-810e82192de5 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.116726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807e8d6-add3-4250-a8ec-810e82192de5 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.122638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.123452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.123816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.124272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.125487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:11:01.125993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.128502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.146583 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1131/2248] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:11:01.148000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bcc0a-1927-4a1d-9193-81f94953d73c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.159779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bcc0a-1927-4a1d-9193-81f94953d73c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.166242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.167003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.167361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.167749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.176785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.179529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.207061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1118/2249] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:11:01 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:01.212052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.222032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381d4e3-0f29-4a07-8c50-309f664b402e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.278459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.279152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.279446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.279813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.280842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.282820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.306726 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1132/2250] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:11:01 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:01.307916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.319524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1e0bf-c193-4f43-8edb-e7db1ba8d0e4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.324414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.325108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.325391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.325691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.326585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.328271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.339237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1119/2251] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:11:01.343473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.355678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd87654-4f1f-4107-a125-892a2437d994 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.361107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf19892-9d05-4852-93df-1520832b5a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.361767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19892-9d05-4852-93df-1520832b5a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.362050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19892-9d05-4852-93df-1520832b5a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.362320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19892-9d05-4852-93df-1520832b5a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.363051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf19892-9d05-4852-93df-1520832b5a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.365020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf19892-9d05-4852-93df-1520832b5a27 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.379126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1133/2252] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:01.380380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.393966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5201d61-bc36-4336-8955-4ffbc1e9a1b6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.399692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.400591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.400870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.401138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] PATH_INFO: `/v3/projects/3831529006404cadb2f12484bdb4181d/users/4e0447d685604e568f04207845effa70/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.420194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3831529006404cadb2f12484bdb4181d, user_id=4e0447d685604e568f04207845effa70, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.424379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.441885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1120/2253] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:01 2022] PUT /identity/v3/projects/3831529006404cadb2f12484bdb4181d/users/4e0447d685604e568f04207845effa70/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:11:01.452333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c6cb-e56c-4c80-bcb7-64eb9a5d1fda None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.452621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c6cb-e56c-4c80-bcb7-64eb9a5d1fda None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.452896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c6cb-e56c-4c80-bcb7-64eb9a5d1fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.459801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:01.481966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d6b6c6cb-e56c-4c80-bcb7-64eb9a5d1fda None None] MFA Rules not processed for user `4e0447d685604e568f04207845effa70`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:01.483171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d6b6c6cb-e56c-4c80-bcb7-64eb9a5d1fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:01.554665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1134/2254] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:01.566373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.568409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:01.635200 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4e538-c068-4905-9a37-c311d300700d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.639011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6e8e9-d0ec-493c-a306-3200ae553734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.639687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e8e9-d0ec-493c-a306-3200ae553734 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.639995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e8e9-d0ec-493c-a306-3200ae553734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.640287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6e8e9-d0ec-493c-a306-3200ae553734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.651360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6e8e9-d0ec-493c-a306-3200ae553734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.652854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6e8e9-d0ec-493c-a306-3200ae553734 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.662382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1121/2255] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:01.681437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6c6cb-e56c-4c80-bcb7-64eb9a5d1fda None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.747922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6c6cb-e56c-4c80-bcb7-64eb9a5d1fda None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:01.752599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:01.753471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.753756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.754034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] PATH_INFO: `/v3/users/4e0447d685604e568f04207845effa70` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.755244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0447d685604e568f04207845effa70)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:01.757276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:01.804659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0447d685604e568f04207845effa70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:01.814346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0447d685604e568f04207845effa70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:01.815050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0447d685604e568f04207845effa70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:01.815674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0447d685604e568f04207845effa70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:01.824183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0447d685604e568f04207845effa70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:01.841388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1135/2256] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:11:01 2022] DELETE /identity/v3/users/4e0447d685604e568f04207845effa70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:01.845827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:01.846361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:01.846456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:01.864287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:01.865503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:01.918124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:01.929276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1122/2257] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:01.939312 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:01.940757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:01.955819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:02.001188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90b2ab-7c3e-4db7-a63e-5772c8366998 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.005602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a35b58-a4bb-4ec4-b3dd-877fe30fb037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.006410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a35b58-a4bb-4ec4-b3dd-877fe30fb037 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.006687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a35b58-a4bb-4ec4-b3dd-877fe30fb037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.007026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a35b58-a4bb-4ec4-b3dd-877fe30fb037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.017370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a35b58-a4bb-4ec4-b3dd-877fe30fb037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.018816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a35b58-a4bb-4ec4-b3dd-877fe30fb037 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.031299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1136/2258] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:02.392602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:02.394094 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:02.417854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8a40c-de8b-428e-9a24-e02e453ad9cd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.423299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.424554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.425212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.425473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] PATH_INFO: `/v3/projects/3831529006404cadb2f12484bdb4181d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.426787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3831529006404cadb2f12484bdb4181d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.428746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.479099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3831529006404cadb2f12484bdb4181d', 'request_id': 'req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:02.486582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3831529006404cadb2f12484bdb4181d', 'request_id': 'req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:02.493210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3831529006404cadb2f12484bdb4181d', 'request_id': 'req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:02.505294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] The token cache is being invalidate because project 3831529006404cadb2f12484bdb4181d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:02.505615 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:02.506300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e602fd1c-9e57-4ede-8b21-b0a0f56dbcf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:02.507877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1123/2259] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:02 2022] DELETE /identity/v3/projects/3831529006404cadb2f12484bdb4181d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:11:02.512779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483122a-475a-407b-98bd-eaeea399e044 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.513069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483122a-475a-407b-98bd-eaeea399e044 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.513350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483122a-475a-407b-98bd-eaeea399e044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.531624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-2483122a-475a-407b-98bd-eaeea399e044 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:02.532822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2483122a-475a-407b-98bd-eaeea399e044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:02.596502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1137/2260] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:02.605883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbaf91-3ef5-454c-801a-871459f6c187 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.606176 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbaf91-3ef5-454c-801a-871459f6c187 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.606470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbaf91-3ef5-454c-801a-871459f6c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.627427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-fcfbaf91-3ef5-454c-801a-871459f6c187 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:02.628708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fcfbaf91-3ef5-454c-801a-871459f6c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:02.639383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1124/2261] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:02.643748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483122a-475a-407b-98bd-eaeea399e044 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:02.654280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483122a-475a-407b-98bd-eaeea399e044 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.659344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.660035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.660323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.660598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.661332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:11:02.661666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.663273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.675563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1138/2262] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:11:02.680383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbaf91-3ef5-454c-801a-871459f6c187 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:02.690286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbaf91-3ef5-454c-801a-871459f6c187 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.694916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.695589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.695884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.696154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.696851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.698740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.724304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1125/2263] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:11:02 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:02.729307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:02.739895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082d2ee-4cd4-4d52-8f51-e0039b84f2bc admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.800927 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.801635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.801922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.802204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.802923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.804912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.825305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1139/2264] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:11:02 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:02.829617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:02.841036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb819445-899d-4b94-a512-1f50922afbd7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.845746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.846408 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.846975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.846975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.847697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.849277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.860281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1126/2265] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:02.864927 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:02.875360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4ce3d-ba92-4fb5-85fc-41af4e1d5615 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.880015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2fce-263d-44ab-bd32-fe09c5419c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.880681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2fce-263d-44ab-bd32-fe09c5419c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.880961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2fce-263d-44ab-bd32-fe09c5419c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.881238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2fce-263d-44ab-bd32-fe09c5419c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.881974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2fce-263d-44ab-bd32-fe09c5419c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.884127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2fce-263d-44ab-bd32-fe09c5419c4c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.894708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1140/2266] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:02.899340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:02.909911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ff1df-c6d0-4a5b-9c98-1032ea167f6a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:02.914776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:02.915698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.915991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.916272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] PATH_INFO: `/v3/projects/e7bdf8455c0540b1b2dd8b5b9f422812/users/53880ad5c0a84c6085b7bb94e593c101/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.930998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bdf8455c0540b1b2dd8b5b9f422812, user_id=53880ad5c0a84c6085b7bb94e593c101, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:02.933735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:02.947027 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1127/2267] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:02 2022] PUT /identity/v3/projects/e7bdf8455c0540b1b2dd8b5b9f422812/users/53880ad5c0a84c6085b7bb94e593c101/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:02.957035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c312fa-05b4-46bb-8bc6-7185d3e6d793 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:02.957333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c312fa-05b4-46bb-8bc6-7185d3e6d793 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:02.957615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c312fa-05b4-46bb-8bc6-7185d3e6d793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:02.984873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f1c312fa-05b4-46bb-8bc6-7185d3e6d793 None None] MFA Rules not processed for user `53880ad5c0a84c6085b7bb94e593c101`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:02.986108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f1c312fa-05b4-46bb-8bc6-7185d3e6d793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:02.995427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:03.053288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1141/2268] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:03.064311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:03.066017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:03.124750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fd76b-b762-4ba1-987a-d74a1815f9f2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:03.128636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4ea46-30b9-4614-9d38-d5e25bde84d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:03.129297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4ea46-30b9-4614-9d38-d5e25bde84d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:03.129587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4ea46-30b9-4614-9d38-d5e25bde84d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:03.129968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4ea46-30b9-4614-9d38-d5e25bde84d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:03.139157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4ea46-30b9-4614-9d38-d5e25bde84d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:03.140645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4ea46-30b9-4614-9d38-d5e25bde84d3 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:03.150309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1128/2269] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:13.050473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=22 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:13.145609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:21.015520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c312fa-05b4-46bb-8bc6-7185d3e6d793 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:21.078689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c312fa-05b4-46bb-8bc6-7185d3e6d793 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:21.083222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:21.084122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:21.084403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:21.084676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] PATH_INFO: `/v3/users/53880ad5c0a84c6085b7bb94e593c101` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:21.085875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53880ad5c0a84c6085b7bb94e593c101)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:21.088524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:21.142099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53880ad5c0a84c6085b7bb94e593c101'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.151075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53880ad5c0a84c6085b7bb94e593c101'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.152092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53880ad5c0a84c6085b7bb94e593c101'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.152437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53880ad5c0a84c6085b7bb94e593c101'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.163766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53880ad5c0a84c6085b7bb94e593c101'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.181796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1142/2270] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:11:21 2022] DELETE /identity/v3/users/53880ad5c0a84c6085b7bb94e593c101 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:21.186364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:21.186837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:21.187197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:21.226053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:21.227264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:21.290055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1129/2271] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:21.299564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:21.301022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:21.361157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2727a9-35d8-4834-90de-732d4f99736a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:21.364985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8431fb-74a8-4d3f-a846-8c4f006ea589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:21.365637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8431fb-74a8-4d3f-a846-8c4f006ea589 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:21.365925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8431fb-74a8-4d3f-a846-8c4f006ea589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:21.366199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8431fb-74a8-4d3f-a846-8c4f006ea589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:21.375882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8431fb-74a8-4d3f-a846-8c4f006ea589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:21.377352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8431fb-74a8-4d3f-a846-8c4f006ea589 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:21.388388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1143/2272] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:11:21.681222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:21.683380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:21.696545 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79352-5b8a-43fe-9757-e91c52ddde81 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:21.702427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:21.703755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:21.704174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:21.704533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] PATH_INFO: `/v3/projects/e7bdf8455c0540b1b2dd8b5b9f422812` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:21.706026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bdf8455c0540b1b2dd8b5b9f422812)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:21.708289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:21.781375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bdf8455c0540b1b2dd8b5b9f422812', 'request_id': 'req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.790847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bdf8455c0540b1b2dd8b5b9f422812', 'request_id': 'req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.797149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bdf8455c0540b1b2dd8b5b9f422812', 'request_id': 'req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.809190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] The token cache is being invalidate because project e7bdf8455c0540b1b2dd8b5b9f422812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:21.809486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.810277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1cdcdaf0-5d22-4fc7-8d7a-77082938d5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:21.811978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1130/2273] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:21 2022] DELETE /identity/v3/projects/e7bdf8455c0540b1b2dd8b5b9f422812 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:21.816861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b7bf-84f2-426e-bdd5-76b205964f3f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:21.817148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b7bf-84f2-426e-bdd5-76b205964f3f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:21.817423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b7bf-84f2-426e-bdd5-76b205964f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:21.836388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b487b7bf-84f2-426e-bdd5-76b205964f3f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:21.837973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b487b7bf-84f2-426e-bdd5-76b205964f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:21.857441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:21.908842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1144/2274] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:21.917490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694effc4-7a32-4729-814e-e3e1b81acaa6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:21.917750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694effc4-7a32-4729-814e-e3e1b81acaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:21.918065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694effc4-7a32-4729-814e-e3e1b81acaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:21.937858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-694effc4-7a32-4729-814e-e3e1b81acaa6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:21.939071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-694effc4-7a32-4729-814e-e3e1b81acaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:21.947661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1131/2275] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:11:21.951986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b7bf-84f2-426e-bdd5-76b205964f3f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:21.961800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487b7bf-84f2-426e-bdd5-76b205964f3f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:21.966990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:21.967698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:21.967985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:21.968270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:21.969004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:11:21.969406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:21.970956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:21.982680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1145/2276] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:11:21.986923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694effc4-7a32-4729-814e-e3e1b81acaa6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:21.997704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694effc4-7a32-4729-814e-e3e1b81acaa6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:22.002963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:22.003683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:22.003967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:22.004239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:22.004942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:22.006839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:22.041179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1132/2277] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:11:21 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:22.042302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:22.052698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd28ab0-12da-493d-af58-68b4cc57712d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:22.114133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:22.114809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:22.115088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:22.115356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:22.116145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:22.118629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:22.139182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1146/2278] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:11:22 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:22.143382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:22.157894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8de9-dcbc-42c0-b7aa-3cbaec4e223d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:22.162680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:22.163997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:22.164284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:22.164561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:22.165306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:22.167002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:22.177913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1133/2279] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:22.182338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:22.192355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436224ee-8131-4144-8a81-db1f47cd54c4 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:22.198014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c4e07-2769-411d-b030-268059b5850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:22.198682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4e07-2769-411d-b030-268059b5850f admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:22.198962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4e07-2769-411d-b030-268059b5850f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:22.199232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4e07-2769-411d-b030-268059b5850f admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:22.200014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c4e07-2769-411d-b030-268059b5850f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:22.201658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c4e07-2769-411d-b030-268059b5850f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:22.212985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1147/2280] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:22.216899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:22.227099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64a03a-e45b-4dcf-b7ab-ce75b77fcaad admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:22.231789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:22.232673 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:22.232950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:22.233222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] PATH_INFO: `/v3/projects/4fea2093aa20467db6b2026575a7fe9c/users/11f6da28b96a4116acbc5c9f5478d0fc/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:22.248931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fea2093aa20467db6b2026575a7fe9c, user_id=11f6da28b96a4116acbc5c9f5478d0fc, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:22.251662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:22.272039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1134/2281] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:22 2022] PUT /identity/v3/projects/4fea2093aa20467db6b2026575a7fe9c/users/11f6da28b96a4116acbc5c9f5478d0fc/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:11:22.283031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:22.283317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:22.283612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:22.310841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] MFA Rules not processed for user `11f6da28b96a4116acbc5c9f5478d0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:22.312219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:22.381382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1148/2282] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:22.391910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:22.393631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:22.416688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:22.455915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802c0e1-a698-4718-9bb4-85238064dbcf admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:22.460208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf1553-ba9c-4994-bef8-f8ec7062d82d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:22.460955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1553-ba9c-4994-bef8-f8ec7062d82d service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:22.461247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1553-ba9c-4994-bef8-f8ec7062d82d service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:22.461529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1553-ba9c-4994-bef8-f8ec7062d82d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:22.478261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf1553-ba9c-4994-bef8-f8ec7062d82d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:22.479974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf1553-ba9c-4994-bef8-f8ec7062d82d service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:22.490072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1135/2283] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:25.046900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:25.048359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:25.068004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:25.119446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b7d22-2480-4dc0-a21a-73a80defbbff None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:25.125760 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:25.126654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.126941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.127239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] PATH_INFO: `/v3/users/d932540855b44f3dbf25bb492958c086` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.128496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d932540855b44f3dbf25bb492958c086)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:25.130518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:25.179896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd932540855b44f3dbf25bb492958c086'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.187072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd932540855b44f3dbf25bb492958c086'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.187833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd932540855b44f3dbf25bb492958c086'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.189432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd932540855b44f3dbf25bb492958c086'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.195245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd932540855b44f3dbf25bb492958c086'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.213011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1149/2284] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:11:25 2022] DELETE /identity/v3/users/d932540855b44f3dbf25bb492958c086 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:25.217909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.218369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.218459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.236297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:25.237482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:25.305910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1136/2285] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:25.315563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:25.317536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:25.379843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5e2e-f781-40fb-a1e8-448a81a774c8 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:25.384994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4055f07-22f5-48a9-b349-232bd728a1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:25.385660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055f07-22f5-48a9-b349-232bd728a1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.385940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055f07-22f5-48a9-b349-232bd728a1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.386213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055f07-22f5-48a9-b349-232bd728a1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.397073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4055f07-22f5-48a9-b349-232bd728a1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:25.398330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4055f07-22f5-48a9-b349-232bd728a1f6 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:25.410974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1150/2286] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:25.519133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:25.520890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:25.534417 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a3bb2-915c-42dd-8094-7979e322aacf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:25.539585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:25.540702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.540991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.541272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] PATH_INFO: `/v3/users/11f6da28b96a4116acbc5c9f5478d0fc` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.542496 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f6da28b96a4116acbc5c9f5478d0fc)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:25.544505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:25.614794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f6da28b96a4116acbc5c9f5478d0fc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.615779 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f6da28b96a4116acbc5c9f5478d0fc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.633108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f6da28b96a4116acbc5c9f5478d0fc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.649931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f6da28b96a4116acbc5c9f5478d0fc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.650720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f6da28b96a4116acbc5c9f5478d0fc'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.673140 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1137/2287] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:11:25 2022] DELETE /identity/v3/users/11f6da28b96a4116acbc5c9f5478d0fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:25.677849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.678279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.678428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.696944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:25.698245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:25.734210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:25.739671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:25.741245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:25.767142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1151/2288] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:25.777269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:25.778732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:25.801331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:25.829914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbaaa4-d43d-4ba4-8331-85a4f7efafe5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:25.834664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:25.835525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.835839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.836120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] PATH_INFO: `/v3/projects/cc999b8c54b943ae9831a29e2d45c5bf` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.837351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc999b8c54b943ae9831a29e2d45c5bf)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:25.838364 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb254c-a0d2-419c-8366-fdc30cba3771 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:25.839311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:25.842733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6f2c9-c9b5-4cdb-8d79-ae95006a8a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:25.843385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6f2c9-c9b5-4cdb-8d79-ae95006a8a4d service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.843700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6f2c9-c9b5-4cdb-8d79-ae95006a8a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.843981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6f2c9-c9b5-4cdb-8d79-ae95006a8a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.853463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6f2c9-c9b5-4cdb-8d79-ae95006a8a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:25.854888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6f2c9-c9b5-4cdb-8d79-ae95006a8a4d service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:25.864504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1152/2289] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:11:25.888390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc999b8c54b943ae9831a29e2d45c5bf', 'request_id': 'req-45fb2c31-1445-4a61-a96e-b0c438f0551e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.897316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc999b8c54b943ae9831a29e2d45c5bf', 'request_id': 'req-45fb2c31-1445-4a61-a96e-b0c438f0551e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.903639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc999b8c54b943ae9831a29e2d45c5bf', 'request_id': 'req-45fb2c31-1445-4a61-a96e-b0c438f0551e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.916310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] The token cache is being invalidate because project cc999b8c54b943ae9831a29e2d45c5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:25.916656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.917470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-45fb2c31-1445-4a61-a96e-b0c438f0551e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:25.919357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1138/2290] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:25 2022] DELETE /identity/v3/projects/cc999b8c54b943ae9831a29e2d45c5bf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:11:25.924495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931992a2-ff40-4560-b733-697e3b3589b2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:25.924866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931992a2-ff40-4560-b733-697e3b3589b2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:25.925148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931992a2-ff40-4560-b733-697e3b3589b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:25.945389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-931992a2-ff40-4560-b733-697e3b3589b2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:25.947146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-931992a2-ff40-4560-b733-697e3b3589b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.014606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1153/2291] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:26.022330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be30f-3eda-4031-84a3-3ee7506548c8 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.022544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be30f-3eda-4031-84a3-3ee7506548c8 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.022939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be30f-3eda-4031-84a3-3ee7506548c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.043497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a13be30f-3eda-4031-84a3-3ee7506548c8 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:26.044883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a13be30f-3eda-4031-84a3-3ee7506548c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.053204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1139/2292] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:26.058170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931992a2-ff40-4560-b733-697e3b3589b2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.068977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931992a2-ff40-4560-b733-697e3b3589b2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.074488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.075477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.075477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.075738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.076477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:11:26.076800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.078412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.092418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1154/2293] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:11:26.096585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13be30f-3eda-4031-84a3-3ee7506548c8 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.106857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13be30f-3eda-4031-84a3-3ee7506548c8 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.111564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.112288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.112573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.112893 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.113583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.115497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.147867 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1140/2294] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:26.149435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.150683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.151309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.168057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31740d-d7be-42dc-a78a-984976062c5f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.221428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257ef8-87cd-4b74-88b1-0abc783b30e4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.226431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.227102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.229443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.229443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.229443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.229740 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.230376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.230652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.230808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.230928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] PATH_INFO: `/v3/projects/4fea2093aa20467db6b2026575a7fe9c` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.232165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fea2093aa20467db6b2026575a7fe9c)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.234069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.247537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:26.253195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1141/2295] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:26.257366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.268115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f68723-ce4e-46a6-a8f2-19d0d349cfe2 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.272816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.273481 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.273762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.274084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.274968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.276654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.283834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fea2093aa20467db6b2026575a7fe9c', 'request_id': 'req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:26.287474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1142/2296] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:11:26.290698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fea2093aa20467db6b2026575a7fe9c', 'request_id': 'req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:26.292156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.296752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fea2093aa20467db6b2026575a7fe9c', 'request_id': 'req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:26.302566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43888e0c-5eab-4c98-b4cb-dfcc6a263a5b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.310032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] The token cache is being invalidate because project 4fea2093aa20467db6b2026575a7fe9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:26.310320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:26.310996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0f5e947-2b6e-4c25-ab6e-5f61a69afb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:26.312846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1155/2297] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:26 2022] DELETE /identity/v3/projects/4fea2093aa20467db6b2026575a7fe9c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:26.315535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:26.317772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611043-53ad-45e0-abfa-07ea67c7236c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.318068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611043-53ad-45e0-abfa-07ea67c7236c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.318349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611043-53ad-45e0-abfa-07ea67c7236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.338455 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-db611043-53ad-45e0-abfa-07ea67c7236c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:26.339706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-db611043-53ad-45e0-abfa-07ea67c7236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.371299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.372270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.372614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.372902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.373650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.375468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.389096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1143/2298] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:26.390581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.392019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.405880 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381555aa-97cf-4601-9a2f-d47699d1114c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.406895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1156/2299] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:26.412167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0efa03-7b1c-4551-b4db-3301e33970ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.413097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0efa03-7b1c-4551-b4db-3301e33970ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.413380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0efa03-7b1c-4551-b4db-3301e33970ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.413653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0efa03-7b1c-4551-b4db-3301e33970ad admin admin] PATH_INFO: `/v3/projects/2694f227c556441581f8e5d4b69dff82/users/48e1e1cbbcd744239db9dca573f93b1d/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.415222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40c60d-544d-412c-afff-948287509f90 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.415516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40c60d-544d-412c-afff-948287509f90 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.415822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40c60d-544d-412c-afff-948287509f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.431329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0efa03-7b1c-4551-b4db-3301e33970ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2694f227c556441581f8e5d4b69dff82, user_id=48e1e1cbbcd744239db9dca573f93b1d, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.434388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0efa03-7b1c-4551-b4db-3301e33970ad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.436764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0c40c60d-544d-412c-afff-948287509f90 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:26.438042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0c40c60d-544d-412c-afff-948287509f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.449831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1157/2300] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:11:26.451326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40c60d-544d-412c-afff-948287509f90 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.460833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1144/2301] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:26 2022] PUT /identity/v3/projects/2694f227c556441581f8e5d4b69dff82/users/48e1e1cbbcd744239db9dca573f93b1d/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:26.463993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40c60d-544d-412c-afff-948287509f90 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.466174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e4b9-4a56-42c7-b033-9f7036ad594b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.466540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e4b9-4a56-42c7-b033-9f7036ad594b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.466899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e4b9-4a56-42c7-b033-9f7036ad594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.488754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-49b3e4b9-4a56-42c7-b033-9f7036ad594b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:26.490060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-49b3e4b9-4a56-42c7-b033-9f7036ad594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.539357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.540716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.541070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.545399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.547494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:11:26.548321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.551189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.571728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1145/2302] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:26.575231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1158/2303] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:11:26.576841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e4b9-4a56-42c7-b033-9f7036ad594b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.585711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.588235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e4b9-4a56-42c7-b033-9f7036ad594b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.588512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:26.598385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.599150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.599514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.599894 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.600685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.605544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.632597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:26.639635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1146/2304] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:11:26.644288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.669650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0064e-57a4-4f1b-8b79-3ef1fc54de3a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.731002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.731787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.732141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.732644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.760608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7d40f-2d73-4a58-ac4d-f9ebfb1c9810 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.770683 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.771912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.772332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.772624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.773338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.775948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.795750 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:26.818367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1147/2305] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:11:26.819487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.824088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.825567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.831350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d47f1-7174-4ffa-ba07-c797312a7f52 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.837546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.838391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1159/2306] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:11:26.838526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.838861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.839186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.840112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.841734 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.854507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1148/2307] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:26.858506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.868808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821711d-0350-49d7-aadd-dd0df368cb4b service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.873541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841162fb-d552-4ea8-a628-4ad2ed252a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.874212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841162fb-d552-4ea8-a628-4ad2ed252a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.874494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841162fb-d552-4ea8-a628-4ad2ed252a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.874769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841162fb-d552-4ea8-a628-4ad2ed252a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.875492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841162fb-d552-4ea8-a628-4ad2ed252a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.877316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841162fb-d552-4ea8-a628-4ad2ed252a65 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.889542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1160/2308] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:26.893536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:26.904634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7385882-a2d3-47d3-8b92-6c4722b9b105 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:26.909434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:26.910484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.910626 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.911038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] PATH_INFO: `/v3/projects/49cb183f481944b89960429592b2e452/users/37ff7420a1b04938a77643cb6834a383/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.929348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cb183f481944b89960429592b2e452, user_id=37ff7420a1b04938a77643cb6834a383, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:26.932250 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:26.946774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1149/2309] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:26 2022] PUT /identity/v3/projects/49cb183f481944b89960429592b2e452/users/37ff7420a1b04938a77643cb6834a383/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:26.958187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756995bc-0674-4818-91d5-9eb1d189254f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:26.958566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756995bc-0674-4818-91d5-9eb1d189254f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:26.958819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756995bc-0674-4818-91d5-9eb1d189254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:26.991229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-756995bc-0674-4818-91d5-9eb1d189254f None None] MFA Rules not processed for user `37ff7420a1b04938a77643cb6834a383`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:26.992886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-756995bc-0674-4818-91d5-9eb1d189254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:27.115755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1161/2310] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:27.126167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:27.128021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:27.196813 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8fe8-e046-4e36-a49d-fbe2658fc7ea admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:27.200602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef322608-4850-4865-996c-70a63bc2a856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:27.201278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef322608-4850-4865-996c-70a63bc2a856 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:27.201560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef322608-4850-4865-996c-70a63bc2a856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:27.201831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef322608-4850-4865-996c-70a63bc2a856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:27.211089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef322608-4850-4865-996c-70a63bc2a856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:27.213188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef322608-4850-4865-996c-70a63bc2a856 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:27.224741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1150/2311] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:29.693320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29435-f614-475c-b693-a9ac91d05708 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:29.693816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29435-f614-475c-b693-a9ac91d05708 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:29.693916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29435-f614-475c-b693-a9ac91d05708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:29.713356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-aac29435-f614-475c-b693-a9ac91d05708 None None] MFA Rules not processed for user `37ff7420a1b04938a77643cb6834a383`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:29.714871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-aac29435-f614-475c-b693-a9ac91d05708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:29.722664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1162/2312] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:31.990174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050aed-6ad2-4011-a14d-be70ae5384e0 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:31.990743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050aed-6ad2-4011-a14d-be70ae5384e0 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:31.990743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050aed-6ad2-4011-a14d-be70ae5384e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:32.018705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-27050aed-6ad2-4011-a14d-be70ae5384e0 None None] MFA Rules not processed for user `48e1e1cbbcd744239db9dca573f93b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:32.020036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-27050aed-6ad2-4011-a14d-be70ae5384e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:32.087847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1151/2313] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:32.092253 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac29435-f614-475c-b693-a9ac91d05708 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:32.101410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:32.171185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac29435-f614-475c-b693-a9ac91d05708 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:32.176969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:32.177654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:32.177944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:32.178219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:32.178941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:32.181087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:32.221582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1163/2314] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:11:32 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:32.225690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050aed-6ad2-4011-a14d-be70ae5384e0 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:32.237903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050aed-6ad2-4011-a14d-be70ae5384e0 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:32.294404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:32.306100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:32.307057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:32.307349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:32.307659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:32.319267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:32.322891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:32.350627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1152/2315] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:11:32 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:11:32.355124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:32.365351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1972-d10f-4fd3-807f-7396d2caaa20 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:32.370486 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:32.371139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:32.371418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:32.371717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:32.372442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:32.374038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:32.384570 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1164/2316] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:32.388555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:32.398628 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985360-5bef-4dce-8d34-8540ab1ecb11 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:32.403328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:32.404508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:32.404790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:32.405066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] PATH_INFO: `/v3/projects/38842d0ab2fb4dbbad70a51ecf282f6e/users/3a22365e52e148d692d53d5ff73e4c62/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:32.420352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38842d0ab2fb4dbbad70a51ecf282f6e, user_id=3a22365e52e148d692d53d5ff73e4c62, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:32.422933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:32.436595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1153/2317] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:32 2022] PUT /identity/v3/projects/38842d0ab2fb4dbbad70a51ecf282f6e/users/3a22365e52e148d692d53d5ff73e4c62/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:32.440534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:32.450647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7502fcc-fd29-4caa-a60f-4741152726c2 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:32.510185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:32.510853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:32.511135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:32.511423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:32.512185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:32.513791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:32.524759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1165/2318] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:32.530528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:32.542047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295aa55-633f-431a-8a49-6ff310330148 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:32.546914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af722b28-1e46-4b69-8698-2c62174d281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:32.547902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722b28-1e46-4b69-8698-2c62174d281f admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:32.548238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722b28-1e46-4b69-8698-2c62174d281f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:32.548523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722b28-1e46-4b69-8698-2c62174d281f admin admin] PATH_INFO: `/v3/projects/38842d0ab2fb4dbbad70a51ecf282f6e/users/3a22365e52e148d692d53d5ff73e4c62/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:32.550571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af722b28-1e46-4b69-8698-2c62174d281f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38842d0ab2fb4dbbad70a51ecf282f6e, user_id=3a22365e52e148d692d53d5ff73e4c62, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:32.553664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af722b28-1e46-4b69-8698-2c62174d281f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:32.570157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1154/2319] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:32 2022] PUT /identity/v3/projects/38842d0ab2fb4dbbad70a51ecf282f6e/users/3a22365e52e148d692d53d5ff73e4c62/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:35.590849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:35.595169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:35.628989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de42f17-31c0-4ffe-97cc-152bc30af24d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:35.796833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:35.797967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:35.798427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:35.798862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] PATH_INFO: `/v3/users/aee723bd75de444a92ec1032e8fb55ce` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:35.805665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee723bd75de444a92ec1032e8fb55ce)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:35.808308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:35.870831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:35.929352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee723bd75de444a92ec1032e8fb55ce'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:35.952757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee723bd75de444a92ec1032e8fb55ce'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:35.955401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee723bd75de444a92ec1032e8fb55ce'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:35.956434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee723bd75de444a92ec1032e8fb55ce'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:35.971626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee723bd75de444a92ec1032e8fb55ce'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:36.002629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1166/2320] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:11:35 2022] DELETE /identity/v3/users/aee723bd75de444a92ec1032e8fb55ce => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:36.007356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:36.008457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:36.008596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:36.037270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:36.038541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:36.122815 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1155/2321] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:36.158566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:36.160402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:36.287669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9fff7-3c12-49e0-93e9-d4d77818554b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:36.302367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ce574-30e7-4d84-87a4-0225f2b89dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:36.303258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ce574-30e7-4d84-87a4-0225f2b89dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:36.303743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ce574-30e7-4d84-87a4-0225f2b89dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:36.304029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ce574-30e7-4d84-87a4-0225f2b89dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:36.319297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ce574-30e7-4d84-87a4-0225f2b89dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:36.321373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ce574-30e7-4d84-87a4-0225f2b89dfd service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:36.368052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1167/2322] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:37.329034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:37.331158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:37.359560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da9912-15f8-4a4c-85a0-b3fa6823ea48 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:37.366979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:37.368290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:37.368749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:37.369921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] PATH_INFO: `/v3/projects/5c363b832d3c4e708a517ff0d3e57915` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:37.390325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c363b832d3c4e708a517ff0d3e57915)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:37.397021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:37.504219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c363b832d3c4e708a517ff0d3e57915', 'request_id': 'req-c57d4a91-71f8-44b9-95f5-4915f892fef6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:37.525826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c363b832d3c4e708a517ff0d3e57915', 'request_id': 'req-c57d4a91-71f8-44b9-95f5-4915f892fef6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:37.533110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c363b832d3c4e708a517ff0d3e57915', 'request_id': 'req-c57d4a91-71f8-44b9-95f5-4915f892fef6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:37.550706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] The token cache is being invalidate because project 5c363b832d3c4e708a517ff0d3e57915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:37.551008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:37.553567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:37.555608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1156/2323] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:37 2022] DELETE /identity/v3/projects/5c363b832d3c4e708a517ff0d3e57915 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:11:39.728113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107e763-14fb-4337-91eb-8a85bc869ea6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:39.728644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107e763-14fb-4337-91eb-8a85bc869ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:39.728644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107e763-14fb-4337-91eb-8a85bc869ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:39.761998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e107e763-14fb-4337-91eb-8a85bc869ea6 None None] MFA Rules not processed for user `3a22365e52e148d692d53d5ff73e4c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:39.763431 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e107e763-14fb-4337-91eb-8a85bc869ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:39.848700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1168/2324] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:39.862773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:39.864975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:39.901785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:39.954442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4a91-71f8-44b9-95f5-4915f892fef6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:39.960144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:39.961371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:39.961655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:39.961926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:39.963762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:40.036707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:40.038453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:40.048754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1157/2325] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:40.109498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c7012-a3fd-40f1-8938-0ea864c3b0d6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:40.109788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c7012-a3fd-40f1-8938-0ea864c3b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:40.110119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c7012-a3fd-40f1-8938-0ea864c3b0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:40.131255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-8c3c7012-a3fd-40f1-8938-0ea864c3b0d6 None None] MFA Rules not processed for user `c35675c94f9a44c7943501d33abb0f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:40.132411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8c3c7012-a3fd-40f1-8938-0ea864c3b0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:40.156054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:40.156218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:40.157751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:40.202868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1169/2326] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:40.250505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42e8a8-a9b9-499f-8588-3d7ffbfec456 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:40.261889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:40.261889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:40.261889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:40.261889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] PATH_INFO: `/v3/users/3baef6c0e86642f799fa8f26dc77e98d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:40.262314 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3baef6c0e86642f799fa8f26dc77e98d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:40.263735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:40.326085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3baef6c0e86642f799fa8f26dc77e98d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:40.326911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3baef6c0e86642f799fa8f26dc77e98d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:40.335325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3baef6c0e86642f799fa8f26dc77e98d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:40.344820 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3baef6c0e86642f799fa8f26dc77e98d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:40.345572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3baef6c0e86642f799fa8f26dc77e98d'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:40.350745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:40.368532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1158/2327] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:11:40 2022] DELETE /identity/v3/users/3baef6c0e86642f799fa8f26dc77e98d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:40.372935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:40.373225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:40.373505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:40.392564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:40.393675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:40.465848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1170/2328] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:40.474988 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:40.477037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:40.609548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3c2b3-b4f2-4b56-97e5-6fb7b3d78ab1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:40.616055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ae3d-72e0-4b6a-801a-feb8d5363d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:40.616732 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ae3d-72e0-4b6a-801a-feb8d5363d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:40.618322 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ae3d-72e0-4b6a-801a-feb8d5363d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:40.618608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ae3d-72e0-4b6a-801a-feb8d5363d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:40.636379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ae3d-72e0-4b6a-801a-feb8d5363d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:40.638203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ae3d-72e0-4b6a-801a-feb8d5363d76 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:40.657982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1159/2329] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:41.213003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:41.214650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:41.233413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9e97-590d-42df-8268-68f86ee5b2c4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:41.247918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:41.249132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:41.249417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:41.249703 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] PATH_INFO: `/v3/projects/40f2d41580ca461e9d5d1cc4b15f54e1` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:41.257177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f2d41580ca461e9d5d1cc4b15f54e1)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:41.259994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:41.392070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f2d41580ca461e9d5d1cc4b15f54e1', 'request_id': 'req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:41.404566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f2d41580ca461e9d5d1cc4b15f54e1', 'request_id': 'req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:41.417507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f2d41580ca461e9d5d1cc4b15f54e1', 'request_id': 'req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:41.440271 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] The token cache is being invalidate because project 40f2d41580ca461e9d5d1cc4b15f54e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:11:41.440831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:41.441651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bfa9b3f9-4633-4f34-8026-bb79497ffdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:11:41.449464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1171/2330] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:11:41 2022] DELETE /identity/v3/projects/40f2d41580ca461e9d5d1cc4b15f54e1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:41.454107 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04a439-0bc2-4702-b0e6-a59ace552299 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:41.454586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04a439-0bc2-4702-b0e6-a59ace552299 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:41.454688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04a439-0bc2-4702-b0e6-a59ace552299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:41.494985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8a04a439-0bc2-4702-b0e6-a59ace552299 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:41.496396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8a04a439-0bc2-4702-b0e6-a59ace552299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:41.590458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1160/2331] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:41.598747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da78f4-1f2a-49fc-8587-6495eb3b9a4f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:41.599368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da78f4-1f2a-49fc-8587-6495eb3b9a4f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:41.599368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da78f4-1f2a-49fc-8587-6495eb3b9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:41.639746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-95da78f4-1f2a-49fc-8587-6495eb3b9a4f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:41.640999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-95da78f4-1f2a-49fc-8587-6495eb3b9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:41.660007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1172/2332] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:41.664766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04a439-0bc2-4702-b0e6-a59ace552299 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:41.681827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04a439-0bc2-4702-b0e6-a59ace552299 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:41.696298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:41.696995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:41.697294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:41.697563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:41.698302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:11:41.698604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:41.700411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:41.750189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1161/2333] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:11:41.754768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da78f4-1f2a-49fc-8587-6495eb3b9a4f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:41.771970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da78f4-1f2a-49fc-8587-6495eb3b9a4f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:41.787464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a26657-a386-479e-ab0a-8373e6ee6ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:41.789529 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26657-a386-479e-ab0a-8373e6ee6ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:41.792926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26657-a386-479e-ab0a-8373e6ee6ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:41.793742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26657-a386-479e-ab0a-8373e6ee6ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:41.797959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26657-a386-479e-ab0a-8373e6ee6ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:41.800341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a26657-a386-479e-ab0a-8373e6ee6ab5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:41.867264 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1173/2334] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:11:41 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:41.873803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:41.890992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bed26-53c2-44ee-a29c-c0fe2e474f4f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:41.895396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bed26-53c2-44ee-a29c-c0fe2e474f4f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:41.896735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bed26-53c2-44ee-a29c-c0fe2e474f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:41.907126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28f850-6314-47b8-bad1-d5e0da3ebb8d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:41.950475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5f5bed26-53c2-44ee-a29c-c0fe2e474f4f None None] MFA Rules not processed for user `48e1e1cbbcd744239db9dca573f93b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:41.952476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5f5bed26-53c2-44ee-a29c-c0fe2e474f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:41.992935 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:42.024933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:42.025717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:42.026002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:42.026306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:42.027005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:42.029933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:42.058519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1174/2335] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:42.068986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1162/2336] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:11:41 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:11:42.069484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bed26-53c2-44ee-a29c-c0fe2e474f4f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:42.098502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bed26-53c2-44ee-a29c-c0fe2e474f4f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:42.118113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:42.118883 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:42.119371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:42.119751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:42.121188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:42.124338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:42.159842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1175/2337] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:11:42.162637 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:42.171885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:42.181724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209e81d-d89c-4042-ae90-19a94a9a08ae admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:42.196715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40201a6-17ba-4e62-a4bb-c82eb3e04bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:42.197542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40201a6-17ba-4e62-a4bb-c82eb3e04bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:42.197901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40201a6-17ba-4e62-a4bb-c82eb3e04bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:42.198182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40201a6-17ba-4e62-a4bb-c82eb3e04bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:42.198995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40201a6-17ba-4e62-a4bb-c82eb3e04bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:42.201984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40201a6-17ba-4e62-a4bb-c82eb3e04bf2 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:42.248245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1163/2338] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:11:42.249202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:42.267915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568d50-9311-48bc-8e65-590c21518604 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:42.273936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:42.275379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:42.275903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:42.276467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] PATH_INFO: `/v3/projects/1bf4d863707447fbb5c03b609ccda4f4/users/68e2e8baebef44c0a2a2616be99f3dd9/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:42.301756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf4d863707447fbb5c03b609ccda4f4, user_id=68e2e8baebef44c0a2a2616be99f3dd9, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:42.306339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:42.331833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1176/2339] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:11:42 2022] PUT /identity/v3/projects/1bf4d863707447fbb5c03b609ccda4f4/users/68e2e8baebef44c0a2a2616be99f3dd9/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:11:42.337620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ac37-c842-4bd5-8604-33dcd7c39567 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:42.337907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ac37-c842-4bd5-8604-33dcd7c39567 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:42.338182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ac37-c842-4bd5-8604-33dcd7c39567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:42.393776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-60d7ac37-c842-4bd5-8604-33dcd7c39567 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:42.395457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-60d7ac37-c842-4bd5-8604-33dcd7c39567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:42.489074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1164/2340] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:42.500141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:42.502057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:42.684960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debb328-ea2b-4842-823d-0706c3a5f4f0 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:42.691626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:42.693525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:42.694094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:42.694799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:42.714070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:42.716103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:42.746591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1177/2341] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:44.553657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286437-53f1-45f9-8d74-94f8216d4a23 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:44.554727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286437-53f1-45f9-8d74-94f8216d4a23 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:44.555165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286437-53f1-45f9-8d74-94f8216d4a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:44.598476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b4286437-53f1-45f9-8d74-94f8216d4a23 None None] MFA Rules not processed for user `68e2e8baebef44c0a2a2616be99f3dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:44.600416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b4286437-53f1-45f9-8d74-94f8216d4a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:44.762582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1165/2342] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:11:44.773563 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:44.775376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:44.881868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1a839-f2e7-4984-962d-c472e7eb9fac service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:44.886646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750e57c-5fab-461d-a579-e6acfc63d144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:44.886998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e57c-5fab-461d-a579-e6acfc63d144 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:44.887282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e57c-5fab-461d-a579-e6acfc63d144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:44.887557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e57c-5fab-461d-a579-e6acfc63d144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:44.899615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750e57c-5fab-461d-a579-e6acfc63d144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:44.903657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750e57c-5fab-461d-a579-e6acfc63d144 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:44.912361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1178/2343] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:11:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:11:46.396584 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:46.397036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:46.397178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:46.417409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] MFA Rules not processed for user `68e2e8baebef44c0a2a2616be99f3dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:46.418639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:46.435639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1166/2344] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:11:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:54.907179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:56.269397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f92c63-a671-4bb9-ac2f-0c0ccb3e76a3 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:56.269397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f92c63-a671-4bb9-ac2f-0c0ccb3e76a3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:56.269397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f92c63-a671-4bb9-ac2f-0c0ccb3e76a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:56.284061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-52f92c63-a671-4bb9-ac2f-0c0ccb3e76a3 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:56.286140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-52f92c63-a671-4bb9-ac2f-0c0ccb3e76a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:56.378709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1179/2345] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:56.425529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:56.427038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:56.428524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=69 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:11:56.537222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ab90b-b9ff-4684-a07b-11a9f6bedac6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:56.544166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:56.544833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:56.545125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:56.545394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:56.554669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:56.556271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:56.566320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1167/2346] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:11:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:11:57.167022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497baf8-b697-4821-9568-5cb3ded2e74c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:57.167523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497baf8-b697-4821-9568-5cb3ded2e74c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:57.167830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497baf8-b697-4821-9568-5cb3ded2e74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:57.186669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5497baf8-b697-4821-9568-5cb3ded2e74c None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:57.187911 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5497baf8-b697-4821-9568-5cb3ded2e74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:57.195659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1180/2347] 10.222.0.78 () {58 vars in 967 bytes} [Mon Jul 4 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:57.207951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:57.218911 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181c5b-a895-4e83-b02b-7640f26c6591 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:57.223992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:57.224645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:57.224927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:57.225349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:57.236586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:57.238174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:57.246955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1168/2348] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:11:57.478757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533ef5-1359-4a5a-a0b2-4c730e84786c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:57.479841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533ef5-1359-4a5a-a0b2-4c730e84786c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:57.480235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533ef5-1359-4a5a-a0b2-4c730e84786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:57.498481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a2533ef5-1359-4a5a-a0b2-4c730e84786c None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:57.499816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a2533ef5-1359-4a5a-a0b2-4c730e84786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:57.507441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1181/2349] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:57.520265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:57.532822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2436509-532a-4833-8b29-8d1a55892597 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:57.540163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:57.540953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:57.541311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:57.541662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:57.551320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:57.553710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:57.569204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1169/2350] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 10:11:57.919729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:57.920021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:57.920297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:57.937384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:11:57.938579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:11:57.946708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1182/2351] 10.222.0.78 () {58 vars in 967 bytes} [Mon Jul 4 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:11:57.959074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:11:57.970510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b13d6-8536-4d8a-8f21-673756d8dd72 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:11:57.975601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418422f8-f385-4d6b-ab56-710dae5d07ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:11:57.976378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418422f8-f385-4d6b-ab56-710dae5d07ee service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:11:57.976729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418422f8-f385-4d6b-ab56-710dae5d07ee service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:11:57.977074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418422f8-f385-4d6b-ab56-710dae5d07ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:11:57.985292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418422f8-f385-4d6b-ab56-710dae5d07ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:11:57.986996 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418422f8-f385-4d6b-ab56-710dae5d07ee service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:11:57.996017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1170/2352] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:12:00.067450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:00.068974 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:00.121317 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04c20-5975-4f7d-a00b-02a603004264 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:00.126155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:00.127042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:00.127329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:00.127635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] PATH_INFO: `/v3/users/37ff7420a1b04938a77643cb6834a383` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:00.128912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ff7420a1b04938a77643cb6834a383)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:00.130848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:00.188289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ff7420a1b04938a77643cb6834a383'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.196801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ff7420a1b04938a77643cb6834a383'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.197432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ff7420a1b04938a77643cb6834a383'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.198027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ff7420a1b04938a77643cb6834a383'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.204965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ff7420a1b04938a77643cb6834a383'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.223552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1183/2353] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:12:00 2022] DELETE /identity/v3/users/37ff7420a1b04938a77643cb6834a383 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:12:00.228375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:00.228853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:00.229063 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:00.259952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:00.261320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:00.323293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1171/2354] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:00.333212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:00.334641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:00.347680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:00.418380 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaa88c-90fd-4cef-9c90-2c30b92ec09a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:00.423098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:00.423798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:00.424083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:00.424357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:00.434896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:00.436382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:00.445892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1184/2355] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:12:00.617231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:00.618680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:00.631351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64d7ad-8da4-4df7-a34a-e839aa531f71 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:00.637940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:00.638818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:00.639174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:00.639457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] PATH_INFO: `/v3/projects/49cb183f481944b89960429592b2e452` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:00.640746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cb183f481944b89960429592b2e452)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:00.642716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:00.661298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:00.693305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cb183f481944b89960429592b2e452', 'request_id': 'req-e3b50093-4611-4571-a95f-14db375c58e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.701385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cb183f481944b89960429592b2e452', 'request_id': 'req-e3b50093-4611-4571-a95f-14db375c58e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.706931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cb183f481944b89960429592b2e452', 'request_id': 'req-e3b50093-4611-4571-a95f-14db375c58e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.718277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] The token cache is being invalidate because project 49cb183f481944b89960429592b2e452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:12:00.718562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.719190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e3b50093-4611-4571-a95f-14db375c58e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:12:00.720782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1172/2356] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:12:00 2022] DELETE /identity/v3/projects/49cb183f481944b89960429592b2e452 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:12:10.441674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=31 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:10.715075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:20.613192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:20.622862 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f74a-2365-43c1-bcf3-3d797c4e6668 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:20.693219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:20.693872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:20.694156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:20.694462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:20.696390 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:20.762717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:20.764236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:20.775290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1185/2357] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:12:30.466512 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d008c-6385-4814-b735-f10d9b796b3b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:30.467100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d008c-6385-4814-b735-f10d9b796b3b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:30.467100 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d008c-6385-4814-b735-f10d9b796b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:30.517212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-7a6d008c-6385-4814-b735-f10d9b796b3b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:30.518404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7a6d008c-6385-4814-b735-f10d9b796b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:30.587299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1173/2358] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:30.615490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:30.617119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:30.732559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5af8-ef31-4971-9898-5d29efde6e50 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:30.744197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:30.744197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:30.744197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:30.744197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:30.748682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:30.750265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:30.759940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1186/2359] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:12:34.516495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e18f-4830-4527-9cf3-c4c5f49a8e77 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:34.517067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e18f-4830-4527-9cf3-c4c5f49a8e77 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:34.517067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e18f-4830-4527-9cf3-c4c5f49a8e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:34.535555 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2c98e18f-4830-4527-9cf3-c4c5f49a8e77 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:34.536789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2c98e18f-4830-4527-9cf3-c4c5f49a8e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:34.545374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1174/2360] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:34.571785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:34.573248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:34.588462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f17732-57d7-4cf9-a6bc-66cf465fe4d7 service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:34.594640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:34.595282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:34.595568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:34.595933 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:34.602322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=100 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:34.605214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:34.607300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:34.617768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1187/2361] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:12:38.813586 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c024-d6af-407a-ba41-fc259a98cf29 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:38.814040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c024-d6af-407a-ba41-fc259a98cf29 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:38.814324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c024-d6af-407a-ba41-fc259a98cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:38.832386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3663c024-d6af-407a-ba41-fc259a98cf29 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:38.833607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3663c024-d6af-407a-ba41-fc259a98cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:38.842066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1175/2362] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:38.888899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:38.900218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68094d22-4a69-4093-8b5e-9e8a1f43911a service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:38.906600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:38.907242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:38.907522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:38.907822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:38.916345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:38.917916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:38.928340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1188/2363] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:12:48.827136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=44 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:48.924072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=8 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:12:49.064589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec8ea1-7a19-4208-aae3-208bb79fc98f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:49.064881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec8ea1-7a19-4208-aae3-208bb79fc98f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:49.065165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec8ea1-7a19-4208-aae3-208bb79fc98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:49.084083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-63ec8ea1-7a19-4208-aae3-208bb79fc98f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:49.085294 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-63ec8ea1-7a19-4208-aae3-208bb79fc98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:49.094756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1176/2364] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:49.117507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:49.129437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4171d-544f-48f8-9dc1-aa5115717c3f service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:49.134999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:49.135665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:49.135953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:49.136229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:49.145540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:49.147126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:49.158623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1189/2365] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:12:54.276022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2341-26c9-47f3-b465-91d585afb7c7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:54.276509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2341-26c9-47f3-b465-91d585afb7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:54.276509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2341-26c9-47f3-b465-91d585afb7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:54.294541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-898b2341-26c9-47f3-b465-91d585afb7c7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:54.296278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-898b2341-26c9-47f3-b465-91d585afb7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:54.304121 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1177/2366] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:54.324530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:54.335435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506f894-512b-426a-a303-61416ad1ae53 service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:54.340898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:54.341520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:54.341827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:54.342097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:54.350855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:54.352365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:54.362370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1190/2367] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:12:57.736641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f2610-349c-4124-8a58-e0a476b25708 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:57.737203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f2610-349c-4124-8a58-e0a476b25708 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:57.737310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f2610-349c-4124-8a58-e0a476b25708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:57.797463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b22f2610-349c-4124-8a58-e0a476b25708 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:57.798678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b22f2610-349c-4124-8a58-e0a476b25708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:57.863927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1178/2368] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:57.909283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:57.910692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:58.004453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593a5e-9c26-4584-b3df-90c2267e6f7a service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:58.009824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:58.010482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:58.010766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:58.011038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:58.019904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:58.021494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:58.030378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1191/2369] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:12:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:12:58.478558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:58.478875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:58.479154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:58.502266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:12:58.503940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:12:58.513380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1179/2370] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:12:58.535401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:12:58.550758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50994172-99f8-48bc-9b2a-8b952917a92a service swift] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:12:58.565043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:12:58.565727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:12:58.566014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:12:58.566289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:12:58.580540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:12:58.582434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:12:58.595125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1192/2371] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:13:08.496381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=53 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:08.590592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=59 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:13.345577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:13.347397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:13.370883 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:13.372322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:13.446026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78bea7-b883-45e1-b5e3-e602b764d64c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:13.451144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf06130-26c6-48e5-bdf8-690850f50569 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:13.451924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06130-26c6-48e5-bdf8-690850f50569 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:13.452211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06130-26c6-48e5-bdf8-690850f50569 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:13.452492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06130-26c6-48e5-bdf8-690850f50569 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:13.454336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fcf06130-26c6-48e5-bdf8-690850f50569 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:13.458444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6aafb1-8d73-4073-bf03-8741ffe8f947 service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:13.463505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293fc4c-c8e7-4984-9045-32c192551f4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:13.464183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293fc4c-c8e7-4984-9045-32c192551f4f service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:13.464466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293fc4c-c8e7-4984-9045-32c192551f4f service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:13.464743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293fc4c-c8e7-4984-9045-32c192551f4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:13.466960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf06130-26c6-48e5-bdf8-690850f50569 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:13.468611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf06130-26c6-48e5-bdf8-690850f50569 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:13.474221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293fc4c-c8e7-4984-9045-32c192551f4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:13.475824 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293fc4c-c8e7-4984-9045-32c192551f4f service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:13.478527 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1180/2372] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:13:13.489810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1193/2373] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:13:15.106937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f558f0-a5ad-4fc6-b41f-11cf23eb9174 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.107463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f558f0-a5ad-4fc6-b41f-11cf23eb9174 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.107567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f558f0-a5ad-4fc6-b41f-11cf23eb9174 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.109101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1181/2374] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:13:15.115287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3402-1700-4507-8b34-c1633c719bbc None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.115835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3402-1700-4507-8b34-c1633c719bbc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.115835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad3402-1700-4507-8b34-c1633c719bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.153124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-61ad3402-1700-4507-8b34-c1633c719bbc None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:15.154949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-61ad3402-1700-4507-8b34-c1633c719bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:15.164644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1194/2375] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:13:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:15.176246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f558f0-a5ad-4fc6-b41f-11cf23eb9174 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:15.177932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-13f558f0-a5ad-4fc6-b41f-11cf23eb9174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:15.263380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f558f0-a5ad-4fc6-b41f-11cf23eb9174 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:15.266989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a6ff-4f0a-4a9b-a289-d4cf35b31f90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:15.267676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a6ff-4f0a-4a9b-a289-d4cf35b31f90 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.267963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a6ff-4f0a-4a9b-a289-d4cf35b31f90 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.268245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a6ff-4f0a-4a9b-a289-d4cf35b31f90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.279304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495a6ff-4f0a-4a9b-a289-d4cf35b31f90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:15.280777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495a6ff-4f0a-4a9b-a289-d4cf35b31f90 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:15.291924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1182/2376] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:13:15.357167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f702f3-b111-4e72-bed3-150c395dd5bb None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.357406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f702f3-b111-4e72-bed3-150c395dd5bb None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.357715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f702f3-b111-4e72-bed3-150c395dd5bb None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.359145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1195/2377] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:13:15.364032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af7e9-85b2-40ea-adb2-3568575e0134 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.364330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af7e9-85b2-40ea-adb2-3568575e0134 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.364617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af7e9-85b2-40ea-adb2-3568575e0134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.384941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9e8af7e9-85b2-40ea-adb2-3568575e0134 None None] MFA Rules not processed for user `a5b5399fad924cabaf1d414bbca2c191`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:15.386163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e8af7e9-85b2-40ea-adb2-3568575e0134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:15.394698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1183/2378] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:13:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:15.406966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f702f3-b111-4e72-bed3-150c395dd5bb None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:15.408711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-48f702f3-b111-4e72-bed3-150c395dd5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:15.422482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f702f3-b111-4e72-bed3-150c395dd5bb None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:15.426183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5589cd-4687-4d7b-83bd-8d9c8279583d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:15.426826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5589cd-4687-4d7b-83bd-8d9c8279583d service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.427113 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5589cd-4687-4d7b-83bd-8d9c8279583d service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.427394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5589cd-4687-4d7b-83bd-8d9c8279583d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.435299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5589cd-4687-4d7b-83bd-8d9c8279583d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:15.436763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5589cd-4687-4d7b-83bd-8d9c8279583d service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:15.444700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1196/2379] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:13:15.529223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe1a-147d-4e2e-9451-b4b54a723e11 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.529519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe1a-147d-4e2e-9451-b4b54a723e11 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.529806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe1a-147d-4e2e-9451-b4b54a723e11 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.531273 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1184/2380] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:13:15.536389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839a25b-a14e-4bd5-8e19-60c2b48a6f3e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.536681 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839a25b-a14e-4bd5-8e19-60c2b48a6f3e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.536958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839a25b-a14e-4bd5-8e19-60c2b48a6f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.555134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a839a25b-a14e-4bd5-8e19-60c2b48a6f3e None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:15.556393 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a839a25b-a14e-4bd5-8e19-60c2b48a6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:15.566566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1197/2381] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:13:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:15.582221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adafe1a-147d-4e2e-9451-b4b54a723e11 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:15.593260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adafe1a-147d-4e2e-9451-b4b54a723e11 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:15.597126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:15.597770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:15.598060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:15.598338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:15.609144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:15.610513 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:15.621315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1185/2382] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:13:17.876537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250a855-b0c1-4de8-b692-134608464a29 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:17.877101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250a855-b0c1-4de8-b692-134608464a29 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:17.877198 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250a855-b0c1-4de8-b692-134608464a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:17.896231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3250a855-b0c1-4de8-b692-134608464a29 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:17.897441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3250a855-b0c1-4de8-b692-134608464a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:17.905709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1198/2383] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:13:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:17.917397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:17.929296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ccbdd-bb92-4614-b3cf-e0a01b4bb767 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:17.934243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282f7e0-32fc-45f5-96db-0dfc31d1cb3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:17.934875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f7e0-32fc-45f5-96db-0dfc31d1cb3a service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:17.935156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f7e0-32fc-45f5-96db-0dfc31d1cb3a service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:17.935431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f7e0-32fc-45f5-96db-0dfc31d1cb3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:17.943461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282f7e0-32fc-45f5-96db-0dfc31d1cb3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:17.945060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282f7e0-32fc-45f5-96db-0dfc31d1cb3a service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:17.953310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1186/2384] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:13:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:13:18.353177 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fb46-73b6-4bbc-aff6-d592e3d5e372 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:18.353463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fb46-73b6-4bbc-aff6-d592e3d5e372 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:18.353737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9fb46-73b6-4bbc-aff6-d592e3d5e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:18.375013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0db9fb46-73b6-4bbc-aff6-d592e3d5e372 None None] MFA Rules not processed for user `68e2e8baebef44c0a2a2616be99f3dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:18.377179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0db9fb46-73b6-4bbc-aff6-d592e3d5e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:18.438594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1199/2385] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:27.949922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:28.431252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=82 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:13:44.767181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10563-39fa-4f1b-bb26-aa86ab13eec5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:44.767737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10563-39fa-4f1b-bb26-aa86ab13eec5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:44.767737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10563-39fa-4f1b-bb26-aa86ab13eec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:44.790727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bea10563-39fa-4f1b-bb26-aa86ab13eec5 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:44.792257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bea10563-39fa-4f1b-bb26-aa86ab13eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:44.807884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1187/2386] 10.222.0.78 () {58 vars in 967 bytes} [Mon Jul 4 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:44.821630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9fb46-73b6-4bbc-aff6-d592e3d5e372 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:44.835052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9fb46-73b6-4bbc-aff6-d592e3d5e372 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:44.840192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:44.840872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:44.841156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:44.841461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:44.850391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:44.852057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:44.861023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1200/2387] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:13:51.507594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92987-4d74-41f9-a587-7394c7ee45bd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:51.508144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92987-4d74-41f9-a587-7394c7ee45bd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:51.508263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92987-4d74-41f9-a587-7394c7ee45bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:51.526318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-44f92987-4d74-41f9-a587-7394c7ee45bd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:51.527609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-44f92987-4d74-41f9-a587-7394c7ee45bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:51.536013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1188/2388] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:51.579965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:51.591890 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786941-c48c-4e8b-85c7-cbf28a149d62 service swift] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:51.598073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:51.598706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:51.598991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:51.599268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:51.607543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:51.609825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:51.619323 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1201/2389] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:13:55.763703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac799d29-7437-4c48-884e-f82271bea9bc None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:55.764266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac799d29-7437-4c48-884e-f82271bea9bc None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:55.764266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac799d29-7437-4c48-884e-f82271bea9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:55.782722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-ac799d29-7437-4c48-884e-f82271bea9bc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:55.783970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-ac799d29-7437-4c48-884e-f82271bea9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:55.792066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1189/2390] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:13:55.812586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:55.823531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2231b-ac07-4917-bfc9-11aefcd4750d service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:55.829612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:55.830239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:55.830585 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:55.830861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:55.838971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:55.840572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:55.849911 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1202/2391] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:13:59.869139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01ff6-2e41-43ff-8c9d-020382089766 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:59.869662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01ff6-2e41-43ff-8c9d-020382089766 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:59.869794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01ff6-2e41-43ff-8c9d-020382089766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:59.888621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f1f01ff6-2e41-43ff-8c9d-020382089766 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:13:59.889840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f1f01ff6-2e41-43ff-8c9d-020382089766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:13:59.897927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1190/2392] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:13:59.923781 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:13:59.935474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c3375-1ad8-4901-a79e-7199820d0b9b service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:13:59.941817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:13:59.942578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:13:59.942874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:13:59.943183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:13:59.951922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:13:59.953538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:13:59.963556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1203/2393] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:14:04.107032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09117d0-094c-4672-aac8-9557a73c049d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:04.107632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09117d0-094c-4672-aac8-9557a73c049d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:04.107632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09117d0-094c-4672-aac8-9557a73c049d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:04.126158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-d09117d0-094c-4672-aac8-9557a73c049d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:14:04.127353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-d09117d0-094c-4672-aac8-9557a73c049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:04.135128 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1191/2394] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:14:04.160398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:04.171733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9604-8cb6-4f26-9e6c-b5aa76fdc9ec service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:04.177306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b595422-03bc-4092-9d4f-f82f5dde96dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:04.177936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595422-03bc-4092-9d4f-f82f5dde96dd service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:04.178219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595422-03bc-4092-9d4f-f82f5dde96dd service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:04.178495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595422-03bc-4092-9d4f-f82f5dde96dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:04.186652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b595422-03bc-4092-9d4f-f82f5dde96dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:04.188777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b595422-03bc-4092-9d4f-f82f5dde96dd service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:04.198228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1204/2395] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:14:09.638431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35ecfb-6a4c-4415-8cc1-69c27cde682a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:09.638941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35ecfb-6a4c-4415-8cc1-69c27cde682a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:09.639041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35ecfb-6a4c-4415-8cc1-69c27cde682a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:09.645091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=16 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:09.658191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5a35ecfb-6a4c-4415-8cc1-69c27cde682a None None] MFA Rules not processed for user `c35675c94f9a44c7943501d33abb0f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:14:09.659393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5a35ecfb-6a4c-4415-8cc1-69c27cde682a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:09.713972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1192/2396] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:14:11.330756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77e5f-2e78-479d-bb87-896deda74ad7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:11.331263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77e5f-2e78-479d-bb87-896deda74ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:11.331263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77e5f-2e78-479d-bb87-896deda74ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:11.337614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=31 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:11.350899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b5a77e5f-2e78-479d-bb87-896deda74ad7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:14:11.352576 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b5a77e5f-2e78-479d-bb87-896deda74ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:11.361382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1205/2397] 10.222.0.60 () {58 vars in 1016 bytes} [Mon Jul 4 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:14:11.383520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35ecfb-6a4c-4415-8cc1-69c27cde682a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:11.396430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35ecfb-6a4c-4415-8cc1-69c27cde682a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:11.402175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:11.402805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:11.403093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:11.403368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:11.411545 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:11.413125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:11.422930 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1193/2398] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:14:21.345672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:21.418361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=30 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:47.688010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a77e5f-2e78-479d-bb87-896deda74ad7 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:47.700055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a77e5f-2e78-479d-bb87-896deda74ad7 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:47.705835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:47.706509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:47.706788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:47.707061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:47.708882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:47.720643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:47.722199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:47.732796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1206/2399] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:14:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:14:47.741606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:47.743246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:47.764585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1bfe2-72d8-4f3f-9c7a-8f15f0856d81 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:47.769544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:47.770425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:47.770713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:47.770997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] PATH_INFO: `/v3/users/68e2e8baebef44c0a2a2616be99f3dd9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:47.772272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e2e8baebef44c0a2a2616be99f3dd9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:47.774495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:47.823103 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e2e8baebef44c0a2a2616be99f3dd9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:47.823784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e2e8baebef44c0a2a2616be99f3dd9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:47.831814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e2e8baebef44c0a2a2616be99f3dd9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:47.838746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e2e8baebef44c0a2a2616be99f3dd9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:47.839390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e2e8baebef44c0a2a2616be99f3dd9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:47.856674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1194/2400] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:14:47 2022] DELETE /identity/v3/users/68e2e8baebef44c0a2a2616be99f3dd9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:14:48.034859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:48.046415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04b1f-dc7a-42dc-aa25-a7b25e4035f9 service placement] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:48.104383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:48.105236 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:48.105518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:48.105792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] PATH_INFO: `/v3/projects/1bf4d863707447fbb5c03b609ccda4f4` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:48.106971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf4d863707447fbb5c03b609ccda4f4)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:48.109561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:48.155001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf4d863707447fbb5c03b609ccda4f4', 'request_id': 'req-bd915f6f-8522-4632-9fcb-94b7e74c8042'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:48.161156 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf4d863707447fbb5c03b609ccda4f4', 'request_id': 'req-bd915f6f-8522-4632-9fcb-94b7e74c8042'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:48.166869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf4d863707447fbb5c03b609ccda4f4', 'request_id': 'req-bd915f6f-8522-4632-9fcb-94b7e74c8042'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:48.179143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] The token cache is being invalidate because project 1bf4d863707447fbb5c03b609ccda4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:14:48.179455 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:48.180239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:14:48.181773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1207/2401] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:14:48 2022] DELETE /identity/v3/projects/1bf4d863707447fbb5c03b609ccda4f4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:14:53.078086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:53.079790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:53.162825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae4d5-e64d-4678-9841-c96cc8d496cd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:53.227821 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:53.228478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:53.228763 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:53.229040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:53.230814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:53.237483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:53.291884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:53.293478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:53.302572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1195/2402] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:14:53.460392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:53.461827 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:53.539046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd915f6f-8522-4632-9fcb-94b7e74c8042 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:53.542700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:53.543347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:53.543666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:53.543947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:53.545716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:53.559043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:53.560516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:53.566921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:14:53.573842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1208/2403] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:14:56.190697 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:56.192204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:56.249245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f4e7f-d704-4060-abb1-a04a8672516d service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:56.252870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fae34-50b5-4b72-8b09-bb8dfecddd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:56.253517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fae34-50b5-4b72-8b09-bb8dfecddd94 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:56.253800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fae34-50b5-4b72-8b09-bb8dfecddd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:56.254075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fae34-50b5-4b72-8b09-bb8dfecddd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:56.255874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-721fae34-50b5-4b72-8b09-bb8dfecddd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:56.269170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fae34-50b5-4b72-8b09-bb8dfecddd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:56.270603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fae34-50b5-4b72-8b09-bb8dfecddd94 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:56.282256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1196/2404] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:14:57.866160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:14:57.868479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:57.886676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf71c4-f2f6-4102-9080-4a59b3b24afb service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:14:57.892777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:14:57.893952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:14:57.894459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:14:57.894945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:14:57.898128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:14:57.913207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:14:57.915510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:14:57.928561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1209/2405] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:14:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:00.811925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:00.812424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:00.812518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:00.836607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] MFA Rules not processed for user `0c3d791666e742e4915d4f52d8dbe03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:00.837814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:00.845442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1197/2406] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:15:01.150696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:01.161179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ec85f-ccc5-44fe-b51c-1b507a7e0e97 service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:01.164789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:01.165426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:01.165711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:01.165989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:01.167867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:01.177581 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:01.179009 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:01.187913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1210/2407] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:01.507676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:01.509412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:01.589053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce9ebd-1fac-4a5d-af41-cbe5e7ab7b2e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:01.594526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:01.595371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:01.595693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:01.595980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:01.597810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:01.610268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:01.611884 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:01.621817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1198/2408] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:03.668526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:03.678123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5217d5-ae99-4969-9655-3c66065af196 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:03.681983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:03.682635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:03.682921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:03.683201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:03.685082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:03.696097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:03.697572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:03.706523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1211/2409] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:10.937277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:10.946677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2c5e-668c-4e11-afe4-6135c3bd3e20 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:10.950263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:10.951454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:10.951777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:10.952061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:10.953857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:10.985609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:11.014936 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:11.016407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:11.025790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1199/2410] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:13.703161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=18 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:19.349334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:19.351653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:19.369707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3a4f4-64b6-44c8-8ae7-11c07b03e117 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:19.376620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:19.377280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:19.377567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:19.377844 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:19.379792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:19.393755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:19.395370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:19.407659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1212/2411] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:15:21.021249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=13 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:29.402979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=6 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:30.706229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:30.707711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:30.718693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7105dc-f342-468f-9e9e-1efc8c1aab1f service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:30.722587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23fb88-e661-4374-8074-713775308394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:30.723464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fb88-e661-4374-8074-713775308394 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:30.723850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fb88-e661-4374-8074-713775308394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:30.724131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fb88-e661-4374-8074-713775308394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:30.726169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9e23fb88-e661-4374-8074-713775308394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:30.788420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23fb88-e661-4374-8074-713775308394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:30.789862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23fb88-e661-4374-8074-713775308394 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:30.799507 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1200/2412] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:33.314152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:33.315674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:33.328034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7aaf7a-5358-4c0f-8666-6b1e93614c5c service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:33.331814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39573c-0a7e-46b2-8224-71a55e297f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:33.332469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39573c-0a7e-46b2-8224-71a55e297f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:33.332752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39573c-0a7e-46b2-8224-71a55e297f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:33.333032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39573c-0a7e-46b2-8224-71a55e297f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:33.335119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9f39573c-0a7e-46b2-8224-71a55e297f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:33.404309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39573c-0a7e-46b2-8224-71a55e297f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:33.405766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39573c-0a7e-46b2-8224-71a55e297f2a service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:33.416470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1213/2413] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:34.421429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b79b-d46b-4b41-a93b-8945b83f2ad2 None None] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:34.421879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b79b-d46b-4b41-a93b-8945b83f2ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:34.422178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b79b-d46b-4b41-a93b-8945b83f2ad2 None None] PATH_INFO: `/` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:34.423999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1201/2414] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:15:34.437835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3988e-0c7b-4cd4-92af-ac3f92275b5e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:34.438391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3988e-0c7b-4cd4-92af-ac3f92275b5e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:34.438921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3988e-0c7b-4cd4-92af-ac3f92275b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:34.469488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-22d3988e-0c7b-4cd4-92af-ac3f92275b5e None None] MFA Rules not processed for user `a5b5399fad924cabaf1d414bbca2c191`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:34.471023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-22d3988e-0c7b-4cd4-92af-ac3f92275b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:34.483604 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1214/2415] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:34.496733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b79b-d46b-4b41-a93b-8945b83f2ad2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:34.509018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b79b-d46b-4b41-a93b-8945b83f2ad2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:34.516109 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2d4eb-8a2b-40ec-a47b-11eac70bde2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:34.517102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2d4eb-8a2b-40ec-a47b-11eac70bde2e service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:34.517609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2d4eb-8a2b-40ec-a47b-11eac70bde2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:34.518153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2d4eb-8a2b-40ec-a47b-11eac70bde2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:34.531488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2d4eb-8a2b-40ec-a47b-11eac70bde2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:34.533091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2d4eb-8a2b-40ec-a47b-11eac70bde2e service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:34.582558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1202/2416] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:34.685479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a310b-db1a-45bd-83f5-76d6d3e204bc None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:34.686281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a310b-db1a-45bd-83f5-76d6d3e204bc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:34.686564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a310b-db1a-45bd-83f5-76d6d3e204bc None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:34.688210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1215/2417] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:15:34.694634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7e6d-c86a-4463-9ef8-e2067c412cb4 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:34.694989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7e6d-c86a-4463-9ef8-e2067c412cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:34.695724 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7e6d-c86a-4463-9ef8-e2067c412cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:34.724236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-43fb7e6d-c86a-4463-9ef8-e2067c412cb4 None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:34.726163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-43fb7e6d-c86a-4463-9ef8-e2067c412cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:34.741678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1203/2418] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:15:34.753754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a310b-db1a-45bd-83f5-76d6d3e204bc None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:34.770535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a310b-db1a-45bd-83f5-76d6d3e204bc None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:34.774762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:34.775652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:34.776112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:34.776735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:34.788582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:34.790036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:34.802155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1216/2419] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:35.954435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb7e6d-c86a-4463-9ef8-e2067c412cb4 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:35.968822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb7e6d-c86a-4463-9ef8-e2067c412cb4 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:35.978223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:35.979480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:35.979982 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:35.980799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:35.983560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:36.000882 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:36.002883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:36.016561 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1204/2420] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:38.395354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:38.397141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:38.413546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa157b-1062-4383-902d-398a4ad295ca service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:38.418887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:38.419912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:38.420212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:38.420490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] PATH_INFO: `/v3/users/c35675c94f9a44c7943501d33abb0f3c` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:38.421697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35675c94f9a44c7943501d33abb0f3c)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:38.423715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:38.473646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35675c94f9a44c7943501d33abb0f3c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.481484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35675c94f9a44c7943501d33abb0f3c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.482174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35675c94f9a44c7943501d33abb0f3c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.482788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35675c94f9a44c7943501d33abb0f3c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.490408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-529d4f29-9fe8-40cc-9ba4-a5acb4ffdc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35675c94f9a44c7943501d33abb0f3c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.508893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1217/2421] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:15:38 2022] DELETE /identity/v3/users/c35675c94f9a44c7943501d33abb0f3c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:38.700276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:38.738862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d118-4192-4ff6-b146-26192c6b8082 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:38.848818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:38.849704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:38.850178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:38.850462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] PATH_INFO: `/v3/projects/6a1d939cb2794275abc996ba95c93811` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:38.851709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1d939cb2794275abc996ba95c93811)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:38.854679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:38.911740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1d939cb2794275abc996ba95c93811', 'request_id': 'req-dec81183-e97f-48b4-9bf2-1c1af44c0429'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.922006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1d939cb2794275abc996ba95c93811', 'request_id': 'req-dec81183-e97f-48b4-9bf2-1c1af44c0429'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.928653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1d939cb2794275abc996ba95c93811', 'request_id': 'req-dec81183-e97f-48b4-9bf2-1c1af44c0429'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.931037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:38.943701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] The token cache is being invalidate because project 6a1d939cb2794275abc996ba95c93811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:15:38.944001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.944689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-dec81183-e97f-48b4-9bf2-1c1af44c0429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:38.947819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1205/2422] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:15:38 2022] DELETE /identity/v3/projects/6a1d939cb2794275abc996ba95c93811 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:38.951403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc23cf4-c830-45d1-b118-a1677c874680 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:38.951732 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc23cf4-c830-45d1-b118-a1677c874680 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:38.952002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc23cf4-c830-45d1-b118-a1677c874680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:38.969815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5cc23cf4-c830-45d1-b118-a1677c874680 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:38.971031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5cc23cf4-c830-45d1-b118-a1677c874680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:39.026602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:39.047465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1218/2423] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:39.055303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062966-dd24-421d-ac41-a3e4f4c2d8a7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.055608 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062966-dd24-421d-ac41-a3e4f4c2d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.055891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062966-dd24-421d-ac41-a3e4f4c2d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.075174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5e062966-dd24-421d-ac41-a3e4f4c2d8a7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:39.076529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5e062966-dd24-421d-ac41-a3e4f4c2d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:39.084576 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1206/2424] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:15:39.089315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc23cf4-c830-45d1-b118-a1677c874680 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:39.101958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc23cf4-c830-45d1-b118-a1677c874680 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:39.106729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:39.108333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.108333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.108625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.109385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:15:39.109816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:39.111835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:39.124921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1219/2425] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:15:39.126382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff45f7-0c9b-40ba-abca-868f499c60f7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.126680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff45f7-0c9b-40ba-abca-868f499c60f7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.126967 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff45f7-0c9b-40ba-abca-868f499c60f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.128865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:39.139021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7a53-0823-4295-8db9-8a5b734b11c0 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:39.143878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:39.144537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.144823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.145101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.145606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4dff45f7-0c9b-40ba-abca-868f499c60f7 None None] MFA Rules not processed for user `ab81044ba8c54e8d808c4aed5a659929`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:39.145861 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:39.146825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4dff45f7-0c9b-40ba-abca-868f499c60f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:39.148105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:39.186874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1220/2426] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:39 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:39.190975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:39.207512 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1207/2427] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:15:39.260073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f737-2c96-4210-816f-0fc95221c1c5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:39.264635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:39.265439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.265593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.265854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.266540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:39.268502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:39.292548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1221/2428] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:15:39 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:15:39.293800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff45f7-0c9b-40ba-abca-868f499c60f7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:39.305516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff45f7-0c9b-40ba-abca-868f499c60f7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:39.310166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:39.310831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.311119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.311391 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.312216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:39.313814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:39.324217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1208/2429] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:39.328328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:39.338650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3294c88-8387-40b7-987b-9f674a3fa981 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:39.343985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980820-676a-4140-aaa4-b4b475f55c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:39.344651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980820-676a-4140-aaa4-b4b475f55c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.344940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980820-676a-4140-aaa4-b4b475f55c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.345221 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980820-676a-4140-aaa4-b4b475f55c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.345956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980820-676a-4140-aaa4-b4b475f55c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:39.347627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980820-676a-4140-aaa4-b4b475f55c0b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:39.359121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1222/2430] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:39.363224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:39.373325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd7408-b002-4155-9074-cfb95433d02e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:39.378115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:39.379015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.379301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.379599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] PATH_INFO: `/v3/projects/995255e8f091414ebadc48f9b681fa0c/users/54e6a2f1b085424fa3307ab382b559fc/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.395454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=995255e8f091414ebadc48f9b681fa0c, user_id=54e6a2f1b085424fa3307ab382b559fc, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:39.398429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:39.414634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1209/2431] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:39 2022] PUT /identity/v3/projects/995255e8f091414ebadc48f9b681fa0c/users/54e6a2f1b085424fa3307ab382b559fc/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:39.426280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b452b-a8f0-4a62-a49a-2dc6d4207f1c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.426830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b452b-a8f0-4a62-a49a-2dc6d4207f1c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.426946 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b452b-a8f0-4a62-a49a-2dc6d4207f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.454126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a60b452b-a8f0-4a62-a49a-2dc6d4207f1c None None] MFA Rules not processed for user `54e6a2f1b085424fa3307ab382b559fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:39.455453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a60b452b-a8f0-4a62-a49a-2dc6d4207f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:39.522119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1223/2432] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:39.532939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:39.534663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:39.618475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485a442-3188-4ddb-96ae-f115ec72e49b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:39.624228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8ff51-e4f5-40ab-af08-248bc89b0971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:39.624953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8ff51-e4f5-40ab-af08-248bc89b0971 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:39.625241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8ff51-e4f5-40ab-af08-248bc89b0971 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:39.625524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8ff51-e4f5-40ab-af08-248bc89b0971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:39.633812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8ff51-e4f5-40ab-af08-248bc89b0971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:39.635390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8ff51-e4f5-40ab-af08-248bc89b0971 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:39.645042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1210/2433] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:41.465144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b452b-a8f0-4a62-a49a-2dc6d4207f1c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:41.478469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:41.535083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b452b-a8f0-4a62-a49a-2dc6d4207f1c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:41.546865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:41.547863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:41.548148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:41.548426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] PATH_INFO: `/v3/users/54e6a2f1b085424fa3307ab382b559fc` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:41.549782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e6a2f1b085424fa3307ab382b559fc)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:41.551765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:41.608619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e6a2f1b085424fa3307ab382b559fc'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:41.617178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e6a2f1b085424fa3307ab382b559fc'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:41.619558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e6a2f1b085424fa3307ab382b559fc'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:41.628896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e6a2f1b085424fa3307ab382b559fc'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:41.637607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e6a2f1b085424fa3307ab382b559fc'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:41.662996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1224/2434] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:15:41 2022] DELETE /identity/v3/users/54e6a2f1b085424fa3307ab382b559fc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:41.664759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:41.665241 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:41.665334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:41.683777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:41.685017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:41.734479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:41.765188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1211/2435] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:15:41.775474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:41.776970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:41.853081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88beed-3fc3-4727-a791-ecf362589f90 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:41.857294 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fff200-3f01-4df7-a6ee-9c3d21459789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:41.857643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff200-3f01-4df7-a6ee-9c3d21459789 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:41.858205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff200-3f01-4df7-a6ee-9c3d21459789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:41.858478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff200-3f01-4df7-a6ee-9c3d21459789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:41.872979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fff200-3f01-4df7-a6ee-9c3d21459789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:41.874767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fff200-3f01-4df7-a6ee-9c3d21459789 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:41.889357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1225/2436] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:42.399157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:42.400678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:42.417755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde8d2c-16ff-447d-853b-221f2328caac None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:42.426485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:42.427480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:42.427856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:42.428201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] PATH_INFO: `/v3/projects/995255e8f091414ebadc48f9b681fa0c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:42.429462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995255e8f091414ebadc48f9b681fa0c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:42.431865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:42.518593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995255e8f091414ebadc48f9b681fa0c', 'request_id': 'req-7d800c6a-03d4-4e3f-93d8-b332c37df450'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:42.532343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995255e8f091414ebadc48f9b681fa0c', 'request_id': 'req-7d800c6a-03d4-4e3f-93d8-b332c37df450'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:42.547359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995255e8f091414ebadc48f9b681fa0c', 'request_id': 'req-7d800c6a-03d4-4e3f-93d8-b332c37df450'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:42.562052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] The token cache is being invalidate because project 995255e8f091414ebadc48f9b681fa0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:15:42.562990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:42.563895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-7d800c6a-03d4-4e3f-93d8-b332c37df450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:42.565766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1212/2437] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:15:42 2022] DELETE /identity/v3/projects/995255e8f091414ebadc48f9b681fa0c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:42.570611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ea39-c416-4d1b-b7a0-6611e91832df None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:42.571130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ea39-c416-4d1b-b7a0-6611e91832df None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:42.571224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ea39-c416-4d1b-b7a0-6611e91832df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:42.603174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9608ea39-c416-4d1b-b7a0-6611e91832df None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:42.605219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9608ea39-c416-4d1b-b7a0-6611e91832df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:42.640666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:42.683944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1226/2438] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:42.691793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8613eb6-0eac-4e85-879f-b2fd996ddcf6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:42.692299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8613eb6-0eac-4e85-879f-b2fd996ddcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:42.692299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8613eb6-0eac-4e85-879f-b2fd996ddcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:42.713434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a8613eb6-0eac-4e85-879f-b2fd996ddcf6 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:42.714977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a8613eb6-0eac-4e85-879f-b2fd996ddcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:42.727304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1213/2439] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:42.728624 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608ea39-c416-4d1b-b7a0-6611e91832df None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:42.739142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608ea39-c416-4d1b-b7a0-6611e91832df None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:42.744895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:42.745899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:42.745899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:42.746325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:42.747069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:15:42.749138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:42.749683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:42.763614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1227/2440] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:15:42.768233 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8613eb6-0eac-4e85-879f-b2fd996ddcf6 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:42.777896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8613eb6-0eac-4e85-879f-b2fd996ddcf6 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:42.785278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:42.786041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:42.786629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:42.786918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:42.788265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:42.790872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:42.832776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1214/2441] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:42 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:42.836510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:42.847642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0f83-b6ba-4fb7-bfb1-8c41750fe3db admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:42.928650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:42.930521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:42.930521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:42.930521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:42.930773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:42.932795 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:42.956180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1228/2442] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:15:42 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:42.960832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:42.971915 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1870b-4b6e-4a55-ab0e-d6b301709ed5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:42.976777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:42.977992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:42.977992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:42.977992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:42.978708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:42.980355 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:42.995738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1215/2443] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:42.997135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.008656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34376a-b169-4589-bb92-30da4c541c76 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.014267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625c94-401b-4558-a3fb-d20f8affd930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.015149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625c94-401b-4558-a3fb-d20f8affd930 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.015648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625c94-401b-4558-a3fb-d20f8affd930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.016693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625c94-401b-4558-a3fb-d20f8affd930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.017421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625c94-401b-4558-a3fb-d20f8affd930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.018990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625c94-401b-4558-a3fb-d20f8affd930 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.030226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1229/2444] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:43.034347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.044652 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170381f-6bcd-44c0-84d6-f3ae1bb82327 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.049307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.050198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.050480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.050755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] PATH_INFO: `/v3/projects/8cd5309c68a1482cbe1601c46dc7052a/users/c61c2f45f4574a0dbd841565f4955444/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.066705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd5309c68a1482cbe1601c46dc7052a, user_id=c61c2f45f4574a0dbd841565f4955444, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.069432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.083345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1216/2445] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:43 2022] PUT /identity/v3/projects/8cd5309c68a1482cbe1601c46dc7052a/users/c61c2f45f4574a0dbd841565f4955444/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:43.097097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee747-32f8-47fd-953d-9f569275bfaf None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.097306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee747-32f8-47fd-953d-9f569275bfaf None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.097586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee747-32f8-47fd-953d-9f569275bfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.124468 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-f5dee747-32f8-47fd-953d-9f569275bfaf None None] MFA Rules not processed for user `c61c2f45f4574a0dbd841565f4955444`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:43.126572 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-f5dee747-32f8-47fd-953d-9f569275bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:43.196220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1230/2446] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:15:43.200787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.281178 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3168-3301-4cd3-b3a8-b374df44ae37 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.287130 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.287839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.288139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.288411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.289819 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.292169 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.301533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:43.323313 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1217/2447] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:43 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:43.327546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee747-32f8-47fd-953d-9f569275bfaf None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.339331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee747-32f8-47fd-953d-9f569275bfaf None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.369034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:43.403232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.404084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.404365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.404646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.405324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.407273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.428633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1231/2448] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:15:43 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:15:43.432596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.444212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb60f4-24de-4028-8a45-a26218199445 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.448952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.449625 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.449910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.450187 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.450943 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.452585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.463330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1218/2449] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:43.467847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.477897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed91b5-9496-4621-8f7a-c2fba218c10a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.482461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.483339 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.483656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.483937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] PATH_INFO: `/v3/projects/edf57e145a784a94ba4609750deef0b2/users/690b6273d5cc4d588874638b66e546eb/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.498943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf57e145a784a94ba4609750deef0b2, user_id=690b6273d5cc4d588874638b66e546eb, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.502290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.515943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1232/2450] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:43 2022] PUT /identity/v3/projects/edf57e145a784a94ba4609750deef0b2/users/690b6273d5cc4d588874638b66e546eb/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:43.525060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.535315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cf87d-4e4c-4b41-876e-def68f5a0d50 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.592700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374d18-5ae0-49c4-a700-7efdc2ba5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.593382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374d18-5ae0-49c4-a700-7efdc2ba5732 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.593672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374d18-5ae0-49c4-a700-7efdc2ba5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.594498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374d18-5ae0-49c4-a700-7efdc2ba5732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.595225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa374d18-5ae0-49c4-a700-7efdc2ba5732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.596856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa374d18-5ae0-49c4-a700-7efdc2ba5732 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.606682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1219/2451] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:43.611838 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.622310 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa8469-2336-4cce-b692-ba2da9f91eb3 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.627182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.628234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.628392 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.628672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] PATH_INFO: `/v3/projects/edf57e145a784a94ba4609750deef0b2/users/690b6273d5cc4d588874638b66e546eb/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.630711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf57e145a784a94ba4609750deef0b2, user_id=690b6273d5cc4d588874638b66e546eb, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.633439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.644098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1233/2452] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:43 2022] PUT /identity/v3/projects/edf57e145a784a94ba4609750deef0b2/users/690b6273d5cc4d588874638b66e546eb/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:43.656210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e339-789b-405b-a544-89a167e5131f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.657009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e339-789b-405b-a544-89a167e5131f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.657361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e339-789b-405b-a544-89a167e5131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.685003 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8944e339-789b-405b-a544-89a167e5131f None None] MFA Rules not processed for user `690b6273d5cc4d588874638b66e546eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:43.686235 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8944e339-789b-405b-a544-89a167e5131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:43.755232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1220/2453] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:43.766593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.768274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:43.850577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8183d6f-48dc-4c17-a49e-5cc57491a345 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.854260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.854913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.855196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.855522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:43.866596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:43.868184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:43.878518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1234/2454] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:43.958302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944e339-789b-405b-a544-89a167e5131f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:43.967787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944e339-789b-405b-a544-89a167e5131f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:43.971877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeccd3-ae14-4aa6-bd93-677f340cb24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:43.972515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeccd3-ae14-4aa6-bd93-677f340cb24d service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:43.972799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeccd3-ae14-4aa6-bd93-677f340cb24d service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:43.973072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeccd3-ae14-4aa6-bd93-677f340cb24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:44.028571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeccd3-ae14-4aa6-bd93-677f340cb24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:44.029912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeccd3-ae14-4aa6-bd93-677f340cb24d service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:44.034081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:44.041270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1221/2455] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:50.799424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:50.861183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d5d1-ad58-4052-bb68-d455cb6f6e20 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:50.866033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:50.866893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:50.867178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:50.867453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] PATH_INFO: `/v3/users/c61c2f45f4574a0dbd841565f4955444` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:50.868677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61c2f45f4574a0dbd841565f4955444)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:50.870641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:50.898183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:50.918305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61c2f45f4574a0dbd841565f4955444'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:50.925440 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61c2f45f4574a0dbd841565f4955444'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:50.926186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61c2f45f4574a0dbd841565f4955444'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:50.926825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61c2f45f4574a0dbd841565f4955444'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:50.933759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61c2f45f4574a0dbd841565f4955444'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:50.950695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1235/2456] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:15:50 2022] DELETE /identity/v3/users/c61c2f45f4574a0dbd841565f4955444 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:50.955855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:50.956316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:50.956430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:50.976638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:50.977952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:51.036858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1222/2457] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:51.046453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:51.047944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:51.105714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70f824-a6e7-468a-9cda-0273c38ee8cf admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:51.112534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:51.113199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:51.113486 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:51.113765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:51.123976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:51.125435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:51.136027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1236/2458] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:51.420016 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:51.421607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:51.434913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa434f-514b-479c-95a3-1621fe1c8097 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:51.440688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:51.441575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:51.441849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:51.442143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] PATH_INFO: `/v3/projects/8cd5309c68a1482cbe1601c46dc7052a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:51.443346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd5309c68a1482cbe1601c46dc7052a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:51.445293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:51.496472 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd5309c68a1482cbe1601c46dc7052a', 'request_id': 'req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.505336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd5309c68a1482cbe1601c46dc7052a', 'request_id': 'req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.514112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd5309c68a1482cbe1601c46dc7052a', 'request_id': 'req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.526221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] The token cache is being invalidate because project 8cd5309c68a1482cbe1601c46dc7052a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:15:51.526511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.527205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.528820 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1223/2459] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:15:51 2022] DELETE /identity/v3/projects/8cd5309c68a1482cbe1601c46dc7052a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:51.532854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:51.542877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7aa37-1228-4644-ac58-da827b6eb0bf service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:51.607149 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:51.608090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:51.608371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:51.608644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] PATH_INFO: `/v3/users/690b6273d5cc4d588874638b66e546eb` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:51.609858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690b6273d5cc4d588874638b66e546eb)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:51.612346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:51.661601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690b6273d5cc4d588874638b66e546eb'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.663287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:51.669322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690b6273d5cc4d588874638b66e546eb'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.670185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690b6273d5cc4d588874638b66e546eb'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.671365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690b6273d5cc4d588874638b66e546eb'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.679088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1c0baaca-f613-4ddb-b690-3adac3a56982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690b6273d5cc4d588874638b66e546eb'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:51.697399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1237/2460] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:15:51 2022] DELETE /identity/v3/users/690b6273d5cc4d588874638b66e546eb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:51.979855 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:51.981383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:52.000467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a4a2-76ed-4bc0-b7c8-b2eb6e4c8c78 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.059369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.060404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.060689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.060966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] PATH_INFO: `/v3/projects/edf57e145a784a94ba4609750deef0b2` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.062164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf57e145a784a94ba4609750deef0b2)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.064148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.089589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:52.114087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf57e145a784a94ba4609750deef0b2', 'request_id': 'req-cc5d986d-e932-4da9-a792-336476322de9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:52.121419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf57e145a784a94ba4609750deef0b2', 'request_id': 'req-cc5d986d-e932-4da9-a792-336476322de9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:52.127679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf57e145a784a94ba4609750deef0b2', 'request_id': 'req-cc5d986d-e932-4da9-a792-336476322de9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:52.138757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] The token cache is being invalidate because project edf57e145a784a94ba4609750deef0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:15:52.139040 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:52.139705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc5d986d-e932-4da9-a792-336476322de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:52.141272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1224/2461] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:15:51 2022] DELETE /identity/v3/projects/edf57e145a784a94ba4609750deef0b2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:52.146288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4c2f-afe5-464d-b563-25e443f483ef None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.146762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4c2f-afe5-464d-b563-25e443f483ef None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.146888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4c2f-afe5-464d-b563-25e443f483ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.164712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-3f5d4c2f-afe5-464d-b563-25e443f483ef None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:52.165893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-3f5d4c2f-afe5-464d-b563-25e443f483ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:52.226397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1238/2462] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:52.234038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00ae7-0052-4398-8791-f37fd8e63dba None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.234331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00ae7-0052-4398-8791-f37fd8e63dba None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.234616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00ae7-0052-4398-8791-f37fd8e63dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.252772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3fb00ae7-0052-4398-8791-f37fd8e63dba None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:52.254005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3fb00ae7-0052-4398-8791-f37fd8e63dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:52.262069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1225/2463] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:52.266129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4c2f-afe5-464d-b563-25e443f483ef None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.283966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4c2f-afe5-464d-b563-25e443f483ef None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.293171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.293840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.294128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.294410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.295176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:15:52.295485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.297124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.309537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1239/2464] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:15:52.313864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb00ae7-0052-4398-8791-f37fd8e63dba None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.322985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb00ae7-0052-4398-8791-f37fd8e63dba None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.327518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.328190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.328471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.328743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.329960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.331868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.360922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1226/2465] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:52 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:52.362199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.372826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007d03-2b36-49c7-b744-0f381f9f2ff1 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.430297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.430967 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.431258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.435808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.436587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.438564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.458763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1240/2466] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:15:52 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:15:52.462997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.474552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b296-ca6e-4d87-b4e3-4f7de8c592c6 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.479237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.479963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.480253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.480537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.481272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.482891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.493464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1227/2467] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:52.497398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.507211 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a6324-6d24-4b29-9485-5cec3f347f78 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.511789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8403-0200-4120-869f-7a0b76d26a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.512488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8403-0200-4120-869f-7a0b76d26a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.512716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8403-0200-4120-869f-7a0b76d26a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.512991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8403-0200-4120-869f-7a0b76d26a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.513706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa8403-0200-4120-869f-7a0b76d26a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.515325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa8403-0200-4120-869f-7a0b76d26a30 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.525884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1241/2468] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:52.530147 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.541022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b73f-dc7d-49ed-bc60-d842f76c7c3c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.545764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.546642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.546929 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.547211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] PATH_INFO: `/v3/projects/9b04f920d67e45ffb4a0fe763338390a/users/f5cee457b35b414ca27afe9b0b0a83a4/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.569630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b04f920d67e45ffb4a0fe763338390a, user_id=f5cee457b35b414ca27afe9b0b0a83a4, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.573980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.589127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1228/2469] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:52 2022] PUT /identity/v3/projects/9b04f920d67e45ffb4a0fe763338390a/users/f5cee457b35b414ca27afe9b0b0a83a4/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:52.600612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273deeb8-e2af-4dbb-a6ad-be83a7667a38 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.601013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273deeb8-e2af-4dbb-a6ad-be83a7667a38 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.601416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273deeb8-e2af-4dbb-a6ad-be83a7667a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.628403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-273deeb8-e2af-4dbb-a6ad-be83a7667a38 None None] MFA Rules not processed for user `f5cee457b35b414ca27afe9b0b0a83a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:52.629611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-273deeb8-e2af-4dbb-a6ad-be83a7667a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:52.648782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:52.696288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1242/2470] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:52.701089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.763201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547045de-38b7-4fab-86ac-86809a8b4e85 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.768389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.769048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.769329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.769600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.770297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.772488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.797008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1229/2471] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:52 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:15:52.801179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273deeb8-e2af-4dbb-a6ad-be83a7667a38 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.811863 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273deeb8-e2af-4dbb-a6ad-be83a7667a38 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.867495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.868190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.868472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.868742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.869420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.871361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.891379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1243/2472] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:15:52 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:52.896019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.906514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547febd-3adb-4729-be7e-79ef4159ffd7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.911223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.911932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.912213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.912488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.913209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.914793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.926229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1230/2473] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:52.930631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:52.941742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268f1a-b59c-4f16-bb3f-2c806bc76b47 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:52.946121 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:52.947004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:52.947291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:52.947590 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] PATH_INFO: `/v3/projects/6f61c39f048445819bdf3acb8d15589e/users/a1271ded72fe4da69a009151347011d5/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:52.966248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f61c39f048445819bdf3acb8d15589e, user_id=a1271ded72fe4da69a009151347011d5, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:52.969165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:52.991311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1244/2474] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:52 2022] PUT /identity/v3/projects/6f61c39f048445819bdf3acb8d15589e/users/a1271ded72fe4da69a009151347011d5/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:52.995462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:53.006056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c482a-336e-43fd-8dd9-2b8c52f12130 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:53.026139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:53.068685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6c53e-54f8-445e-b73f-ee7311307922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:53.069372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c53e-54f8-445e-b73f-ee7311307922 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:53.069661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c53e-54f8-445e-b73f-ee7311307922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:53.069942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c53e-54f8-445e-b73f-ee7311307922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:53.070677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6c53e-54f8-445e-b73f-ee7311307922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:53.072318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6c53e-54f8-445e-b73f-ee7311307922 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:53.082688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1231/2475] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:53.087161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:53.098077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012957f-9d7f-4dcd-b1fc-87e370aa0474 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:53.102777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:53.103889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:53.104246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:53.104586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] PATH_INFO: `/v3/projects/6f61c39f048445819bdf3acb8d15589e/users/a1271ded72fe4da69a009151347011d5/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:53.106640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f61c39f048445819bdf3acb8d15589e, user_id=a1271ded72fe4da69a009151347011d5, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:53.109318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:53.120742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1245/2476] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:53 2022] PUT /identity/v3/projects/6f61c39f048445819bdf3acb8d15589e/users/a1271ded72fe4da69a009151347011d5/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:53.131796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf45e5-dfc1-4a02-b2c5-e9b14fc31a53 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:53.132096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf45e5-dfc1-4a02-b2c5-e9b14fc31a53 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:53.132381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf45e5-dfc1-4a02-b2c5-e9b14fc31a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:53.161214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0ebf45e5-dfc1-4a02-b2c5-e9b14fc31a53 None None] MFA Rules not processed for user `a1271ded72fe4da69a009151347011d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:53.162441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0ebf45e5-dfc1-4a02-b2c5-e9b14fc31a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:53.234448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1232/2477] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:53.250420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:53.256866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:53.326568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e6b52-cb80-4987-8171-0cdb8bbb5b9f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:53.330387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:53.331140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:53.331613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:53.331901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:53.341545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:53.343279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:53.354186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1246/2478] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:53.584726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf45e5-dfc1-4a02-b2c5-e9b14fc31a53 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:53.594386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf45e5-dfc1-4a02-b2c5-e9b14fc31a53 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:53.598509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744e4e3-dcd2-43b7-a7e1-3ae88272d555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:53.599161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e4e3-dcd2-43b7-a7e1-3ae88272d555 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:53.599462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e4e3-dcd2-43b7-a7e1-3ae88272d555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:53.599757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e4e3-dcd2-43b7-a7e1-3ae88272d555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:53.658681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744e4e3-dcd2-43b7-a7e1-3ae88272d555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:53.660204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744e4e3-dcd2-43b7-a7e1-3ae88272d555 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:53.669325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1233/2479] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:56.384026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:56.401597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:56.447120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918948a8-6ad2-4bfb-a8c7-cea9312b06a8 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:56.451657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:56.452515 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:56.452792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:56.453064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] PATH_INFO: `/v3/users/f5cee457b35b414ca27afe9b0b0a83a4` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:56.454238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5cee457b35b414ca27afe9b0b0a83a4)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:56.456204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:56.502813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5cee457b35b414ca27afe9b0b0a83a4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:56.510108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5cee457b35b414ca27afe9b0b0a83a4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:56.510772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5cee457b35b414ca27afe9b0b0a83a4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:56.511424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5cee457b35b414ca27afe9b0b0a83a4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:56.518465 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5cee457b35b414ca27afe9b0b0a83a4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:56.536071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1247/2480] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:15:56 2022] DELETE /identity/v3/users/f5cee457b35b414ca27afe9b0b0a83a4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:56.540669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:56.541160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:56.541358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:56.561638 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:56.563121 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:56.602800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:56.624380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1234/2481] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:15:56.633963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:56.635396 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:56.693574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25f815-f90d-4e63-ab36-f531cc3774bf admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:56.697283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877215-d462-418d-af88-acc903f89721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:56.697931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877215-d462-418d-af88-acc903f89721 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:56.698217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877215-d462-418d-af88-acc903f89721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:56.698496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877215-d462-418d-af88-acc903f89721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:56.708152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877215-d462-418d-af88-acc903f89721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:56.709617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95877215-d462-418d-af88-acc903f89721 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:56.719086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1248/2482] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:56.994725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:56.996232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:57.010549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76792f-3166-4472-bfad-2360e4838b01 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:57.015183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:57.016093 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.016377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.016654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] PATH_INFO: `/v3/projects/9b04f920d67e45ffb4a0fe763338390a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.018464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b04f920d67e45ffb4a0fe763338390a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:57.020448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:57.067293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b04f920d67e45ffb4a0fe763338390a', 'request_id': 'req-827c0adb-ac92-4555-af8d-d445b74ebac9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.074906 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b04f920d67e45ffb4a0fe763338390a', 'request_id': 'req-827c0adb-ac92-4555-af8d-d445b74ebac9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.081379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b04f920d67e45ffb4a0fe763338390a', 'request_id': 'req-827c0adb-ac92-4555-af8d-d445b74ebac9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.092340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] The token cache is being invalidate because project 9b04f920d67e45ffb4a0fe763338390a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:15:57.092629 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.093257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.094787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1235/2483] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:15:56 2022] DELETE /identity/v3/projects/9b04f920d67e45ffb4a0fe763338390a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:57.098776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877215-d462-418d-af88-acc903f89721 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:57.108398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877215-d462-418d-af88-acc903f89721 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:57.143908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:57.167969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:57.168768 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.169049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.169321 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] PATH_INFO: `/v3/users/a1271ded72fe4da69a009151347011d5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.170500 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1271ded72fe4da69a009151347011d5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:57.172455 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:57.216289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1271ded72fe4da69a009151347011d5'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.223144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1271ded72fe4da69a009151347011d5'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.223905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1271ded72fe4da69a009151347011d5'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.224544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1271ded72fe4da69a009151347011d5'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.231553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-97eb380f-61f9-42a1-80aa-dbb8f92c2c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1271ded72fe4da69a009151347011d5'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.248475 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1249/2484] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:15:57 2022] DELETE /identity/v3/users/a1271ded72fe4da69a009151347011d5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:57.523421 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:57.524955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:57.541231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c0adb-ac92-4555-af8d-d445b74ebac9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:57.600796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:57.601668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.601955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.602234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] PATH_INFO: `/v3/projects/6f61c39f048445819bdf3acb8d15589e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.603436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f61c39f048445819bdf3acb8d15589e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:57.605385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:57.651526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f61c39f048445819bdf3acb8d15589e', 'request_id': 'req-13a4d2cf-358e-4a10-8e60-80299c524316'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.664183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f61c39f048445819bdf3acb8d15589e', 'request_id': 'req-13a4d2cf-358e-4a10-8e60-80299c524316'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.669897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f61c39f048445819bdf3acb8d15589e', 'request_id': 'req-13a4d2cf-358e-4a10-8e60-80299c524316'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.671818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:57.684005 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] The token cache is being invalidate because project 6f61c39f048445819bdf3acb8d15589e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:15:57.684497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.685177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-13a4d2cf-358e-4a10-8e60-80299c524316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:57.686771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1236/2485] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:15:57 2022] DELETE /identity/v3/projects/6f61c39f048445819bdf3acb8d15589e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:57.691783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28586d-9947-4947-8557-18ce9c822d83 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.692269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28586d-9947-4947-8557-18ce9c822d83 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.692378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28586d-9947-4947-8557-18ce9c822d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.709949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-dc28586d-9947-4947-8557-18ce9c822d83 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:57.711066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-dc28586d-9947-4947-8557-18ce9c822d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:57.769687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1250/2486] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:57.777609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812f05-2b35-4c47-9eac-288671126d6b None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.777902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812f05-2b35-4c47-9eac-288671126d6b None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.778184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812f05-2b35-4c47-9eac-288671126d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.796430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-94812f05-2b35-4c47-9eac-288671126d6b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:57.797633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-94812f05-2b35-4c47-9eac-288671126d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:57.805661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1237/2487] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:57.809627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28586d-9947-4947-8557-18ce9c822d83 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:57.819718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28586d-9947-4947-8557-18ce9c822d83 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:57.824307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:57.824965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.825249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.825524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.826251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:15:57.826559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:57.828203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:57.840322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1251/2488] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:15:57.844542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94812f05-2b35-4c47-9eac-288671126d6b None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:57.853630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94812f05-2b35-4c47-9eac-288671126d6b None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:57.858281 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:57.858925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.859211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.859487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.860215 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:57.862105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:57.888729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1238/2489] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:57 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:15:57.893382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:57.903722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de56f3-2381-4f69-b87b-c317def66ca3 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:57.944885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:57.962754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:57.963357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:57.963670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:57.963951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:57.964682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:57.966610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:57.986472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1252/2490] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:15:57 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:57.990708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.000956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f378-8a28-4142-b50e-2d27c4bc2d3b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.006015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.006668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.006948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.007221 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.007976 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.009560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.020490 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1239/2491] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:58.024614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.034987 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df838a-ff96-47a9-87e8-eb3fe8a4c08c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.039517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4c7e-e165-4c61-97f0-2df986c35f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.040200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4c7e-e165-4c61-97f0-2df986c35f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.040488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4c7e-e165-4c61-97f0-2df986c35f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.040766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4c7e-e165-4c61-97f0-2df986c35f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.041491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4c7e-e165-4c61-97f0-2df986c35f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.043086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4c7e-e165-4c61-97f0-2df986c35f73 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.052910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1253/2492] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:58.056877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.067138 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319f242-d414-4276-8bfa-17582486a4d0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.071743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.072609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.072887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.073159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] PATH_INFO: `/v3/projects/4c1015ba527c4cfba76cea20afca99c0/users/93e17524f1a146689aba2ffcebc35b34/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.088334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1015ba527c4cfba76cea20afca99c0, user_id=93e17524f1a146689aba2ffcebc35b34, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.091034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.104155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1240/2493] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:58 2022] PUT /identity/v3/projects/4c1015ba527c4cfba76cea20afca99c0/users/93e17524f1a146689aba2ffcebc35b34/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:58.115342 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784599ca-a42d-4ad2-9ae2-2ba621a778c2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.115664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784599ca-a42d-4ad2-9ae2-2ba621a778c2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.115943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784599ca-a42d-4ad2-9ae2-2ba621a778c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.142105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-784599ca-a42d-4ad2-9ae2-2ba621a778c2 None None] MFA Rules not processed for user `93e17524f1a146689aba2ffcebc35b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:58.143928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-784599ca-a42d-4ad2-9ae2-2ba621a778c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:58.207756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1254/2494] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:58.212614 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.275344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fb5f-ad09-467f-9817-b5ed4250d4f5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.280031 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.280685 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.280966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.281245 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.281925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.283839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.309599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1241/2495] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:58 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:58.313805 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784599ca-a42d-4ad2-9ae2-2ba621a778c2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.328869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784599ca-a42d-4ad2-9ae2-2ba621a778c2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.392526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.394998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.394998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.394998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.394998 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.397325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.421216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1255/2496] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:15:58 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:15:58.423926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.435332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bfe96-c806-4402-bb91-895c15a4b292 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.440050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.440718 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.441008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.441291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.442152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.444234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.457627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1242/2497] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:58.463335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.474589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe3a5-f28e-407c-a7a6-8f38073216aa admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.479237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.480159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.480635 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.480917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] PATH_INFO: `/v3/projects/d008fb14b5bf41fc936efe83a8603680/users/082f4b8cfcaa4286a88989abfd6afc4f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.495973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d008fb14b5bf41fc936efe83a8603680, user_id=082f4b8cfcaa4286a88989abfd6afc4f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.498746 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.512118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1256/2498] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:58 2022] PUT /identity/v3/projects/d008fb14b5bf41fc936efe83a8603680/users/082f4b8cfcaa4286a88989abfd6afc4f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:58.517280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.527456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e939-5f4e-45bd-809f-2f535badfca5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.591382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29f03-6b75-4ba3-917e-726d792c6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.592208 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f03-6b75-4ba3-917e-726d792c6298 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.592379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f03-6b75-4ba3-917e-726d792c6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.592660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f03-6b75-4ba3-917e-726d792c6298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.593397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d29f03-6b75-4ba3-917e-726d792c6298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.595002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d29f03-6b75-4ba3-917e-726d792c6298 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.605085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1243/2499] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:15:58.609319 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.620350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba083-3c9a-4ca3-b155-993e420c07ee admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.625070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.625960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.626245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.626524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] PATH_INFO: `/v3/projects/d008fb14b5bf41fc936efe83a8603680/users/082f4b8cfcaa4286a88989abfd6afc4f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.630226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d008fb14b5bf41fc936efe83a8603680, user_id=082f4b8cfcaa4286a88989abfd6afc4f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.632744 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.644086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1257/2500] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:15:58 2022] PUT /identity/v3/projects/d008fb14b5bf41fc936efe83a8603680/users/082f4b8cfcaa4286a88989abfd6afc4f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:58.655277 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bce612-9008-42f2-8b17-124d1fe4b421 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.655568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bce612-9008-42f2-8b17-124d1fe4b421 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.655878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bce612-9008-42f2-8b17-124d1fe4b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.664331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:58.690937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-35bce612-9008-42f2-8b17-124d1fe4b421 None None] MFA Rules not processed for user `082f4b8cfcaa4286a88989abfd6afc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:58.693011 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-35bce612-9008-42f2-8b17-124d1fe4b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:58.766538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1244/2501] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:58.779481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:58.781258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:58.787736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:58.840852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec9d5-9e84-48ac-814e-21eb61618bcc admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:58.844968 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:58.845615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:58.845930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:58.846205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:58.855464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:58.856936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:58.867052 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1258/2502] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:15:59.170847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bce612-9008-42f2-8b17-124d1fe4b421 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:59.181434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bce612-9008-42f2-8b17-124d1fe4b421 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:59.186705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082f4b8cfcaa4286a88989abfd6afc4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd008fb14b5bf41fc936efe83a8603680', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:59.187600 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:59.187950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:59.188232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:59.188972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:15:59.189291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:59.191482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:59.204403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1245/2503] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:15:59.208087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:59.217517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23a83-252b-4866-82d6-599edbc007a4 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:59.222406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082f4b8cfcaa4286a88989abfd6afc4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd008fb14b5bf41fc936efe83a8603680', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:59.223376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:59.223698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:59.223977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:59.224700 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:59.229536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:59.257654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1259/2504] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:15:59 2022] POST /identity/v3/projects => generated 354 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:15:59.261618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:59.271858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589917e-c904-43e0-866b-dfc391571e4a tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:59.330220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082f4b8cfcaa4286a88989abfd6afc4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd008fb14b5bf41fc936efe83a8603680', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:59.330912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:59.331198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:59.331474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:59.332230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:15:59.332537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:59.334135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:59.345310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1246/2505] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:15:59.383308 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:59.393411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1f127-44fe-4eb6-999d-890bd8a10acc tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:59.398272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '082f4b8cfcaa4286a88989abfd6afc4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd008fb14b5bf41fc936efe83a8603680', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:59.399130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:59.399416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:59.399734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] PATH_INFO: `/v3/projects/d91cc3fa840d4a6db07efc8a473917ad` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:59.400912 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d91cc3fa840d4a6db07efc8a473917ad)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:59.402823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:59.451401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91cc3fa840d4a6db07efc8a473917ad', 'request_id': 'req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.458091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91cc3fa840d4a6db07efc8a473917ad', 'request_id': 'req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.463684 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91cc3fa840d4a6db07efc8a473917ad', 'request_id': 'req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.476901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] The token cache is being invalidate because project d91cc3fa840d4a6db07efc8a473917ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:15:59.477193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.477859 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d770b0a4-c7fc-478e-8b1f-50f5ad7e7726 tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.479493 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1260/2506] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:15:59 2022] DELETE /identity/v3/projects/d91cc3fa840d4a6db07efc8a473917ad => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:59.671383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:59.673164 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:59.740878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878417ac-c42a-43b2-8e15-294af7b60e0c tempest-VolumeQuotaClassesTest-1559741501 tempest-VolumeQuotaClassesTest-1559741501-project-admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:15:59.752046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:15:59.797254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:15:59.798129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:59.798410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:59.798687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] PATH_INFO: `/v3/users/93e17524f1a146689aba2ffcebc35b34` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:59.799928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e17524f1a146689aba2ffcebc35b34)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:15:59.801852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:15:59.847053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e17524f1a146689aba2ffcebc35b34'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.847719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e17524f1a146689aba2ffcebc35b34'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.854931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e17524f1a146689aba2ffcebc35b34'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.861887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e17524f1a146689aba2ffcebc35b34'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.862506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e17524f1a146689aba2ffcebc35b34'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:15:59.879616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1247/2507] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:15:59 2022] DELETE /identity/v3/users/93e17524f1a146689aba2ffcebc35b34 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:15:59.884230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:15:59.884715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:15:59.884841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:15:59.902577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:15:59.903752 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:15:59.962582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1261/2508] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:15:59.973696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:15:59.975120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:00.032781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553f52-bc89-403a-a091-80bf76ab7ad7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:00.036455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:00.037099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:00.037386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:00.037665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:00.046639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:00.048099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:00.057664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1248/2509] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:16:00.342159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:00.343651 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:00.359070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2b942-d30f-4f70-b366-52e958121258 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:00.366084 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:00.366947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:00.367222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:00.367490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] PATH_INFO: `/v3/projects/4c1015ba527c4cfba76cea20afca99c0` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:00.368847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1015ba527c4cfba76cea20afca99c0)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:00.370776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:00.373489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:00.421020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1015ba527c4cfba76cea20afca99c0', 'request_id': 'req-a722d0a3-9af5-4444-bd11-03691074c932'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.427887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1015ba527c4cfba76cea20afca99c0', 'request_id': 'req-a722d0a3-9af5-4444-bd11-03691074c932'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.433645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1015ba527c4cfba76cea20afca99c0', 'request_id': 'req-a722d0a3-9af5-4444-bd11-03691074c932'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.447783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] The token cache is being invalidate because project 4c1015ba527c4cfba76cea20afca99c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:16:00.448076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.448710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.450425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1262/2510] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:16:00 2022] DELETE /identity/v3/projects/4c1015ba527c4cfba76cea20afca99c0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:00.454416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:00.464082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f54cfb-fce6-42f5-84f0-1e57a0e92a75 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:00.498847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:00.523885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:00.524755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:00.525035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:00.525308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] PATH_INFO: `/v3/users/082f4b8cfcaa4286a88989abfd6afc4f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:00.526486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=082f4b8cfcaa4286a88989abfd6afc4f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:00.528412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:00.574039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082f4b8cfcaa4286a88989abfd6afc4f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.574696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082f4b8cfcaa4286a88989abfd6afc4f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.582310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082f4b8cfcaa4286a88989abfd6afc4f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.589447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082f4b8cfcaa4286a88989abfd6afc4f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.590070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2602369e-8d83-4087-93f4-f7987a9f9012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082f4b8cfcaa4286a88989abfd6afc4f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:00.607073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1249/2511] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:16:00 2022] DELETE /identity/v3/users/082f4b8cfcaa4286a88989abfd6afc4f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:00.885174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:00.886750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:00.900386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d0a3-9af5-4444-bd11-03691074c932 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:00.957638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:00.958428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:00.958711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:00.958986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] PATH_INFO: `/v3/projects/d008fb14b5bf41fc936efe83a8603680` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:00.960196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d008fb14b5bf41fc936efe83a8603680)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:00.962254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.011868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd008fb14b5bf41fc936efe83a8603680', 'request_id': 'req-d9d7c6f0-cb32-4838-ac27-083b63ae437a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:01.017971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd008fb14b5bf41fc936efe83a8603680', 'request_id': 'req-d9d7c6f0-cb32-4838-ac27-083b63ae437a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:01.023842 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd008fb14b5bf41fc936efe83a8603680', 'request_id': 'req-d9d7c6f0-cb32-4838-ac27-083b63ae437a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:01.037642 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] The token cache is being invalidate because project d008fb14b5bf41fc936efe83a8603680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:16:01.037925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:01.038538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d9d7c6f0-cb32-4838-ac27-083b63ae437a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:01.040116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1263/2512] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:16:00 2022] DELETE /identity/v3/projects/d008fb14b5bf41fc936efe83a8603680 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:01.045066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1551a3-f336-4034-b907-9f6d114869cf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.045569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1551a3-f336-4034-b907-9f6d114869cf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.045682 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1551a3-f336-4034-b907-9f6d114869cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.064095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2c1551a3-f336-4034-b907-9f6d114869cf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:01.065298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2c1551a3-f336-4034-b907-9f6d114869cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:01.123881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1250/2513] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:01.131771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75952f7-241d-4893-a145-883707798f1b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.132062 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75952f7-241d-4893-a145-883707798f1b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.132345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75952f7-241d-4893-a145-883707798f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.151355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d75952f7-241d-4893-a145-883707798f1b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:01.152603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d75952f7-241d-4893-a145-883707798f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:01.161275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1264/2514] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:01.165522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1551a3-f336-4034-b907-9f6d114869cf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.175328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1551a3-f336-4034-b907-9f6d114869cf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.179923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.180572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.180853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.181127 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.181845 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:16:01.182151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.183759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.195252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1251/2515] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:16:01.199462 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75952f7-241d-4893-a145-883707798f1b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.209513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75952f7-241d-4893-a145-883707798f1b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.214137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.214791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.215083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.215363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.216094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.218039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.231478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:01.246272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1265/2516] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:16:01.250476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.260466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae4f69-127a-42d8-84c0-a5939633f6cd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.302758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:01.319694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.320375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.320663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.320946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.321639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.323635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.342752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1252/2517] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:16:01.346969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.357794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f24a-1876-49bc-90c6-997fe47631bd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.363418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.364193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.364473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.364747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.365471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.367064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.377594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1266/2518] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:01.381582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.392945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a353cdd-ca63-42f4-b2c8-eb25f6b48e39 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.398509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e2281-1f0f-4b6f-8008-ae57ed4009c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.399205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2281-1f0f-4b6f-8008-ae57ed4009c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.399492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2281-1f0f-4b6f-8008-ae57ed4009c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.399824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2281-1f0f-4b6f-8008-ae57ed4009c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.400532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e2281-1f0f-4b6f-8008-ae57ed4009c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.402137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e2281-1f0f-4b6f-8008-ae57ed4009c5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.413319 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1253/2519] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:16:01.417517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.427940 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c18f46-7b0a-4c6e-a544-1e68d009a600 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.432688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.433593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.433870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.434145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] PATH_INFO: `/v3/projects/8cf13eac4ba84a8fbb48e9b144e3b6f0/users/422c39d3a0a94fb2afac7c452a4e3a51/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.448937 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf13eac4ba84a8fbb48e9b144e3b6f0, user_id=422c39d3a0a94fb2afac7c452a4e3a51, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.451632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.465528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1267/2520] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:16:01 2022] PUT /identity/v3/projects/8cf13eac4ba84a8fbb48e9b144e3b6f0/users/422c39d3a0a94fb2afac7c452a4e3a51/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:01.477382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02a1e6-f7cc-4bef-b15d-b6bf56da99f1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.477680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02a1e6-f7cc-4bef-b15d-b6bf56da99f1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.477990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02a1e6-f7cc-4bef-b15d-b6bf56da99f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.504467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1d02a1e6-f7cc-4bef-b15d-b6bf56da99f1 None None] MFA Rules not processed for user `422c39d3a0a94fb2afac7c452a4e3a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:01.505700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1d02a1e6-f7cc-4bef-b15d-b6bf56da99f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:01.572470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1254/2521] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:01.577101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.637557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf21e-a703-4b81-af73-0fb230741496 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.642403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.643140 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.643505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.644453 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.645223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.647451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.672587 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1268/2522] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:16:01.676585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02a1e6-f7cc-4bef-b15d-b6bf56da99f1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.687506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02a1e6-f7cc-4bef-b15d-b6bf56da99f1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.743670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.744287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.744575 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.744853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.745535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.747470 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.767642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1255/2523] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:16:01.772537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.782826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e997-f577-4c6a-869f-de06cbecce2c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.787866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.788526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.788814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.789095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.789820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.791420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.802019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1269/2524] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:01.806115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.821634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f179f6-c7bc-41e6-af4a-65c48a51abfa admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.826264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f47bf-e599-464a-9e63-f98a7b45f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.826921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f47bf-e599-464a-9e63-f98a7b45f65d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.827209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f47bf-e599-464a-9e63-f98a7b45f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.827494 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f47bf-e599-464a-9e63-f98a7b45f65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.828254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f47bf-e599-464a-9e63-f98a7b45f65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.829848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f47bf-e599-464a-9e63-f98a7b45f65d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.840920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1256/2525] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:01.844949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:01.855150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84e470-a68c-40e7-a26c-a20d832f9593 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:01.859812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:01.860710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.860992 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.861268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] PATH_INFO: `/v3/projects/fb5f8de82abc458a898bc4cf9db3f969/users/a588ddfec76a455cacd0511fec1d1a8a/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.876629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5f8de82abc458a898bc4cf9db3f969, user_id=a588ddfec76a455cacd0511fec1d1a8a, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:01.879984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:01.893340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1270/2526] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:16:01 2022] PUT /identity/v3/projects/fb5f8de82abc458a898bc4cf9db3f969/users/a588ddfec76a455cacd0511fec1d1a8a/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:01.903689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86386-24dd-4261-8d1b-5f379b75a11a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:01.903985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86386-24dd-4261-8d1b-5f379b75a11a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:01.904270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86386-24dd-4261-8d1b-5f379b75a11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:01.930559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-34f86386-24dd-4261-8d1b-5f379b75a11a None None] MFA Rules not processed for user `a588ddfec76a455cacd0511fec1d1a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:01.931793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-34f86386-24dd-4261-8d1b-5f379b75a11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:01.950304 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:01.997787 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1257/2527] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:02.002150 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:02.063166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a06e3-36fb-4f86-9832-31bf23008a15 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:02.068457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:02.069118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.069402 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.069686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.070374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:02.072322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:02.085058 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:02.098238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1271/2528] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:16:02 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:16:02.102276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f86386-24dd-4261-8d1b-5f379b75a11a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:02.113467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f86386-24dd-4261-8d1b-5f379b75a11a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:02.168497 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:02.169157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.169441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.169713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.170403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:02.172327 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:02.192720 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1258/2529] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:16:02 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:16:02.196704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:02.206953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756810-f6fd-43fe-a60c-c97051db2db6 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:02.211532 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:02.212218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.212502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.212779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.213502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:02.215111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:02.226146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1272/2530] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:02.230129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:02.241076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431580d-48a7-47df-b2ad-d90cb68904eb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:02.245913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:02.246801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.247101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.247369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] PATH_INFO: `/v3/projects/dd337c1c109d454994a87239689722de/users/17dd932d2196421599e61520e19e153e/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.261921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd337c1c109d454994a87239689722de, user_id=17dd932d2196421599e61520e19e153e, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:02.264542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:02.277450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1259/2531] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:16:02 2022] PUT /identity/v3/projects/dd337c1c109d454994a87239689722de/users/17dd932d2196421599e61520e19e153e/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:02.281368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:02.292557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e62db-56e5-4467-aee2-e53a4ad223c5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:02.352449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654b84c-c435-49cf-bf9a-2606e9f9d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:02.353120 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654b84c-c435-49cf-bf9a-2606e9f9d1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.353406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654b84c-c435-49cf-bf9a-2606e9f9d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.353683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654b84c-c435-49cf-bf9a-2606e9f9d1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.354415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654b84c-c435-49cf-bf9a-2606e9f9d1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:02.356056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654b84c-c435-49cf-bf9a-2606e9f9d1f1 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:02.367083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1273/2532] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:02.371220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:02.382357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702da68-c2e9-4ecc-a256-5326108d8b72 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:02.387521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:02.388448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.388731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.389039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] PATH_INFO: `/v3/projects/dd337c1c109d454994a87239689722de/users/17dd932d2196421599e61520e19e153e/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.391039 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd337c1c109d454994a87239689722de, user_id=17dd932d2196421599e61520e19e153e, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:02.393699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:02.404449 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1260/2533] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:16:02 2022] PUT /identity/v3/projects/dd337c1c109d454994a87239689722de/users/17dd932d2196421599e61520e19e153e/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:02.468788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.469073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.469345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.496429 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] MFA Rules not processed for user `17dd932d2196421599e61520e19e153e`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:02.497638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:02.565300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1274/2534] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:02.575977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:02.577745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:02.635551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573afe-a9a6-4e85-b4e6-a7e4e56169df admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:02.639317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:02.639989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:02.640276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:02.640554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:02.650850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:02.652317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:02.663000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1261/2535] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:03.140541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:03.142049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:03.154925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7321a-162b-4025-871c-a88cdbca5145 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:03.158456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:03.159100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:03.159388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:03.159693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:03.215972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:03.217427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:03.226340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1275/2536] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:07.178396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:07.187066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7711f-dade-42d7-ace9-e5421bc35db5 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:07.190871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0d54c-4dd8-48c0-b7a3-5a639d6f5b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:07.191516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0d54c-4dd8-48c0-b7a3-5a639d6f5b47 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:07.191864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0d54c-4dd8-48c0-b7a3-5a639d6f5b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:07.192193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0d54c-4dd8-48c0-b7a3-5a639d6f5b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:07.204269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:07.250679 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0d54c-4dd8-48c0-b7a3-5a639d6f5b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:07.252084 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0d54c-4dd8-48c0-b7a3-5a639d6f5b47 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:07.261119 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1262/2537] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:09.322669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:09.326914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:09.386394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323d203-efa3-4038-83d7-900b02cb14d4 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:09.391083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:09.392152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:09.392443 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:09.392719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] PATH_INFO: `/v3/users/422c39d3a0a94fb2afac7c452a4e3a51` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:09.393964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=422c39d3a0a94fb2afac7c452a4e3a51)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:09.395931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:09.441719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422c39d3a0a94fb2afac7c452a4e3a51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:09.449909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422c39d3a0a94fb2afac7c452a4e3a51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:09.450530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422c39d3a0a94fb2afac7c452a4e3a51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:09.451158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422c39d3a0a94fb2afac7c452a4e3a51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:09.458503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422c39d3a0a94fb2afac7c452a4e3a51'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:09.475181 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1276/2538] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:16:09 2022] DELETE /identity/v3/users/422c39d3a0a94fb2afac7c452a4e3a51 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:09.479889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:09.480356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:09.480650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:09.499101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:09.500330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:09.558263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1263/2539] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:09.568658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:09.570069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:09.627326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752e00e-ad15-42ec-8e4e-fe0e61d3c4bb admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:09.631942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:09.632589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:09.632870 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:09.633141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:09.642507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:09.644012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:09.653701 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1277/2540] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:09.931874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:09.933403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:09.948300 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942cd1c-443a-4819-bd1a-d6aa390513fa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:09.953261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:09.954132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:09.954482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:09.954687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] PATH_INFO: `/v3/projects/8cf13eac4ba84a8fbb48e9b144e3b6f0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:09.956035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf13eac4ba84a8fbb48e9b144e3b6f0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:09.957902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:10.010230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf13eac4ba84a8fbb48e9b144e3b6f0', 'request_id': 'req-0c807545-6ca4-48ef-b67c-fe14b50b91e0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.019659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf13eac4ba84a8fbb48e9b144e3b6f0', 'request_id': 'req-0c807545-6ca4-48ef-b67c-fe14b50b91e0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.026285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf13eac4ba84a8fbb48e9b144e3b6f0', 'request_id': 'req-0c807545-6ca4-48ef-b67c-fe14b50b91e0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.038032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] The token cache is being invalidate because project 8cf13eac4ba84a8fbb48e9b144e3b6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:16:10.038316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.038945 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.040531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1264/2541] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:16:09 2022] DELETE /identity/v3/projects/8cf13eac4ba84a8fbb48e9b144e3b6f0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:10.044671 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:10.054814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035ed6-7477-4e40-838b-4c47263c3df8 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:10.073914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:10.113464 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:10.114320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:10.114599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:10.114869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] PATH_INFO: `/v3/users/a588ddfec76a455cacd0511fec1d1a8a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:10.116081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a588ddfec76a455cacd0511fec1d1a8a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:10.118033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:10.163269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a588ddfec76a455cacd0511fec1d1a8a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.169981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a588ddfec76a455cacd0511fec1d1a8a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.170718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a588ddfec76a455cacd0511fec1d1a8a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.171373 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a588ddfec76a455cacd0511fec1d1a8a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.178536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a588ddfec76a455cacd0511fec1d1a8a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.195891 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1278/2542] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:16:10 2022] DELETE /identity/v3/users/a588ddfec76a455cacd0511fec1d1a8a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:10.474932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:10.476548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:10.493050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807545-6ca4-48ef-b67c-fe14b50b91e0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:10.530665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:10.554909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:10.555824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:10.560603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:10.560603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] PATH_INFO: `/v3/projects/fb5f8de82abc458a898bc4cf9db3f969` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:10.561338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5f8de82abc458a898bc4cf9db3f969)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:10.563367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:10.612394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5f8de82abc458a898bc4cf9db3f969', 'request_id': 'req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.619537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5f8de82abc458a898bc4cf9db3f969', 'request_id': 'req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.625132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5f8de82abc458a898bc4cf9db3f969', 'request_id': 'req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.636433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] The token cache is being invalidate because project fb5f8de82abc458a898bc4cf9db3f969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:16:10.636717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.637344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.638895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1265/2543] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:16:10 2022] DELETE /identity/v3/projects/fb5f8de82abc458a898bc4cf9db3f969 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:16:10.642892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:10.644952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:10.658007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757e3e-63ec-4652-8e54-73992d034a78 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:10.717742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:10.718612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:10.718893 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:10.719166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] PATH_INFO: `/v3/users/17dd932d2196421599e61520e19e153e` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:10.720385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17dd932d2196421599e61520e19e153e)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:10.722365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:10.766356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:10.768091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17dd932d2196421599e61520e19e153e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.777511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17dd932d2196421599e61520e19e153e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.778487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17dd932d2196421599e61520e19e153e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.779300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17dd932d2196421599e61520e19e153e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.786448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b843b20a-8e82-4a34-b689-5f486743c376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17dd932d2196421599e61520e19e153e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:10.803882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1279/2544] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:16:10 2022] DELETE /identity/v3/users/17dd932d2196421599e61520e19e153e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:11.082550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.084454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:11.103234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e4f9-6448-4b35-a0bc-ecf980d3f4e9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.161154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.161961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.162252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.162535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] PATH_INFO: `/v3/projects/dd337c1c109d454994a87239689722de` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.163805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd337c1c109d454994a87239689722de)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.165726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.213136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd337c1c109d454994a87239689722de', 'request_id': 'req-5a4a1372-7473-4712-9a82-3ef844bb530f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:11.220423 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd337c1c109d454994a87239689722de', 'request_id': 'req-5a4a1372-7473-4712-9a82-3ef844bb530f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:11.226634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd337c1c109d454994a87239689722de', 'request_id': 'req-5a4a1372-7473-4712-9a82-3ef844bb530f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:11.233777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:11.239623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] The token cache is being invalidate because project dd337c1c109d454994a87239689722de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:16:11.239948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:11.240823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5a4a1372-7473-4712-9a82-3ef844bb530f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:11.242871 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1266/2545] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:16:11 2022] DELETE /identity/v3/projects/dd337c1c109d454994a87239689722de => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:11.248966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdff67-48ac-4f4e-9ec7-17514525e7a9 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.249260 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdff67-48ac-4f4e-9ec7-17514525e7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.249539 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdff67-48ac-4f4e-9ec7-17514525e7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.267341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ccbdff67-48ac-4f4e-9ec7-17514525e7a9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:11.268685 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ccbdff67-48ac-4f4e-9ec7-17514525e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:11.328160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1280/2546] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:11.336529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5407-194c-403b-ad47-c24049c69ccf None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.336820 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5407-194c-403b-ad47-c24049c69ccf None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.337102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5407-194c-403b-ad47-c24049c69ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.355847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-cddc5407-194c-403b-ad47-c24049c69ccf None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:11.357056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cddc5407-194c-403b-ad47-c24049c69ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:11.366657 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1267/2547] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:11.371049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdff67-48ac-4f4e-9ec7-17514525e7a9 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.380695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdff67-48ac-4f4e-9ec7-17514525e7a9 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.385314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.385962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.386241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.386516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.387241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:16:11.387551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.389206 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.400822 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1281/2548] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:16:11.405069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5407-194c-403b-ad47-c24049c69ccf None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.414816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5407-194c-403b-ad47-c24049c69ccf None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.419415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.420090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.420376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.420654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.421342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.423240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.449124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1268/2549] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:16:11 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:16:11.453073 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.463547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664dc00-d5bb-4494-b873-347e7c1d3166 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.518969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.519657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.519944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.520222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.520906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.523087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.542607 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1282/2550] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:16:11 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:16:11.546654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.557572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a7ad9-5160-42b3-8e06-9df1aac924a5 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.562254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.562925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.563207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.563482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.564240 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.565859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.576877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1269/2551] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:11.580943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.591004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1be4d-0d3b-4dfd-9d5f-c5370b04126c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.595669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe2671-dcc5-4c90-9329-b4b04ada4fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.596857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2671-dcc5-4c90-9329-b4b04ada4fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.597144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2671-dcc5-4c90-9329-b4b04ada4fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.597421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2671-dcc5-4c90-9329-b4b04ada4fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.598226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe2671-dcc5-4c90-9329-b4b04ada4fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.599868 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe2671-dcc5-4c90-9329-b4b04ada4fe5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.610424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1283/2552] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:11.615184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.625272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb857-83a6-4eab-9d15-c1f94da8de00 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.631206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.632530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.632824 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.633106 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] PATH_INFO: `/v3/projects/958666ce0e254ad59364d122ee7475b1/users/6b3231c47d6041bcb67e50deb8fdb961/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.656101 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958666ce0e254ad59364d122ee7475b1, user_id=6b3231c47d6041bcb67e50deb8fdb961, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.658788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.672491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1270/2553] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:16:11 2022] PUT /identity/v3/projects/958666ce0e254ad59364d122ee7475b1/users/6b3231c47d6041bcb67e50deb8fdb961/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:11.683960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe15a-8f9d-48ec-adb5-a9f6cd154418 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.684449 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe15a-8f9d-48ec-adb5-a9f6cd154418 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.684627 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe15a-8f9d-48ec-adb5-a9f6cd154418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.710925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ad0fe15a-8f9d-48ec-adb5-a9f6cd154418 None None] MFA Rules not processed for user `6b3231c47d6041bcb67e50deb8fdb961`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:11.712178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ad0fe15a-8f9d-48ec-adb5-a9f6cd154418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:11.729003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:11.777481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1284/2554] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:11.789670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:11.791387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:11.848722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abc9e-ddeb-45c2-b261-2164e1994521 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:11.852426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef7dfe-0f90-43bb-ab85-0dbd4909ad45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:11.853070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7dfe-0f90-43bb-ab85-0dbd4909ad45 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:11.853358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7dfe-0f90-43bb-ab85-0dbd4909ad45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:11.853642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7dfe-0f90-43bb-ab85-0dbd4909ad45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:11.862105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef7dfe-0f90-43bb-ab85-0dbd4909ad45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:11.863538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef7dfe-0f90-43bb-ab85-0dbd4909ad45 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:11.872609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1271/2555] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:21.774686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=19 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:21.843549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe15a-8f9d-48ec-adb5-a9f6cd154418 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:21.868516 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:21.905099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe15a-8f9d-48ec-adb5-a9f6cd154418 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:21.909692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:21.910568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:21.910852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:21.911132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] PATH_INFO: `/v3/users/6b3231c47d6041bcb67e50deb8fdb961` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:21.912357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3231c47d6041bcb67e50deb8fdb961)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:21.914287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:21.959427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3231c47d6041bcb67e50deb8fdb961'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:21.966599 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3231c47d6041bcb67e50deb8fdb961'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:21.967210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3231c47d6041bcb67e50deb8fdb961'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:21.967829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3231c47d6041bcb67e50deb8fdb961'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:21.974657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3231c47d6041bcb67e50deb8fdb961'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:21.991519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1285/2556] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:16:21 2022] DELETE /identity/v3/users/6b3231c47d6041bcb67e50deb8fdb961 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:21.996009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21014335-622a-420e-b499-b0de51db07e2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:21.996292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21014335-622a-420e-b499-b0de51db07e2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:21.996570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21014335-622a-420e-b499-b0de51db07e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.014806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-21014335-622a-420e-b499-b0de51db07e2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:22.016056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-21014335-622a-420e-b499-b0de51db07e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:22.078825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1272/2557] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:22.089184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.090541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:22.147503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2584-9d32-44cb-984d-69cd5b1276af admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.151220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705962e-ff2e-4753-b5d5-02c622f3cddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.151990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705962e-ff2e-4753-b5d5-02c622f3cddf service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.152275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705962e-ff2e-4753-b5d5-02c622f3cddf service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.152549 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705962e-ff2e-4753-b5d5-02c622f3cddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.161512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705962e-ff2e-4753-b5d5-02c622f3cddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.162942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705962e-ff2e-4753-b5d5-02c622f3cddf service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.172637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1286/2558] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:22.434854 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21014335-622a-420e-b499-b0de51db07e2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.436521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-21014335-622a-420e-b499-b0de51db07e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:22.449398 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21014335-622a-420e-b499-b0de51db07e2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.454064 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.454934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.455223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.455534 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] PATH_INFO: `/v3/projects/958666ce0e254ad59364d122ee7475b1` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.456801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=958666ce0e254ad59364d122ee7475b1)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.458700 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.507505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958666ce0e254ad59364d122ee7475b1', 'request_id': 'req-96a52a87-3dac-40f1-82e8-df7ba4d697ad'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:22.513891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958666ce0e254ad59364d122ee7475b1', 'request_id': 'req-96a52a87-3dac-40f1-82e8-df7ba4d697ad'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:22.519981 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958666ce0e254ad59364d122ee7475b1', 'request_id': 'req-96a52a87-3dac-40f1-82e8-df7ba4d697ad'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:22.531151 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] The token cache is being invalidate because project 958666ce0e254ad59364d122ee7475b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:16:22.531442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:22.532115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-96a52a87-3dac-40f1-82e8-df7ba4d697ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:22.534265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1273/2559] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:16:22 2022] DELETE /identity/v3/projects/958666ce0e254ad59364d122ee7475b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:22.539299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0abc24-10c1-4684-be25-d92259a0548c None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.539615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0abc24-10c1-4684-be25-d92259a0548c None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.539898 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0abc24-10c1-4684-be25-d92259a0548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.558134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-6b0abc24-10c1-4684-be25-d92259a0548c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:22.559412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6b0abc24-10c1-4684-be25-d92259a0548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:22.577330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:22.621178 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1287/2560] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:22.628872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c42166-5746-4dac-8cb6-8082b86e8f57 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.629160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c42166-5746-4dac-8cb6-8082b86e8f57 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.629437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c42166-5746-4dac-8cb6-8082b86e8f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.647792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-57c42166-5746-4dac-8cb6-8082b86e8f57 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:22.648983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-57c42166-5746-4dac-8cb6-8082b86e8f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:22.656765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1274/2561] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:22.661375 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0abc24-10c1-4684-be25-d92259a0548c None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.671085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0abc24-10c1-4684-be25-d92259a0548c None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.676230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.676881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.677165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.677444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.678207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:16:22.678513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.680143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.691779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1288/2562] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:16:22.695975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c42166-5746-4dac-8cb6-8082b86e8f57 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.705293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c42166-5746-4dac-8cb6-8082b86e8f57 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.710167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.710853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.711141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.711422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.712162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.714056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.740431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1275/2563] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:16:22 2022] POST /identity/v3/projects => generated 395 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:16:22.744486 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.755108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d5b8-d44c-4abd-ba96-4df2fb43e7de admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.810237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.810953 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.811238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.811517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.812244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.814169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.835109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1289/2564] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:16:22 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:16:22.839231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.849672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2a3b-b466-45c4-bbfb-441796353ca4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.854249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.854905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.855188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.855464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.856228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.857803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.869609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1276/2565] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:22.873873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.884540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d410751-54c2-431b-b640-be39eebdf439 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.889204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3e14b-0b63-4cd5-ad13-cc49dc749dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.889854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e14b-0b63-4cd5-ad13-cc49dc749dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.890138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e14b-0b63-4cd5-ad13-cc49dc749dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.890417 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e14b-0b63-4cd5-ad13-cc49dc749dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.891180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3e14b-0b63-4cd5-ad13-cc49dc749dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.892808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3e14b-0b63-4cd5-ad13-cc49dc749dd3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.902851 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1290/2566] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:16:22.906881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:22.918874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399cc26-3734-42b3-9f7f-e000bf79aff9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:22.923909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:22.925305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.925583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.925856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] PATH_INFO: `/v3/projects/02d20717df98496ab6dc58643e896933/users/7104d843143d474fa7b674915532841d/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.941185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d20717df98496ab6dc58643e896933, user_id=7104d843143d474fa7b674915532841d, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:22.943856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:22.956425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1277/2567] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:16:22 2022] PUT /identity/v3/projects/02d20717df98496ab6dc58643e896933/users/7104d843143d474fa7b674915532841d/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:22.966633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023563-2e90-4657-9c36-7b867822eff6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:22.966926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023563-2e90-4657-9c36-7b867822eff6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:22.967208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023563-2e90-4657-9c36-7b867822eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:22.993544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1d023563-2e90-4657-9c36-7b867822eff6 None None] MFA Rules not processed for user `7104d843143d474fa7b674915532841d`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:22.994741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1d023563-2e90-4657-9c36-7b867822eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:23.057258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1291/2568] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:23.069159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:23.070890 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:23.092631 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:23.130767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd56a08-d993-4cee-9a1d-dc189c7ff5ff admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:23.134428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa239-ea38-482b-8c85-2385f7b6d09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:23.135075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa239-ea38-482b-8c85-2385f7b6d09d service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:23.135364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa239-ea38-482b-8c85-2385f7b6d09d service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:23.135674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa239-ea38-482b-8c85-2385f7b6d09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:23.144258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfa239-ea38-482b-8c85-2385f7b6d09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:23.145873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfa239-ea38-482b-8c85-2385f7b6d09d service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:23.155086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1278/2569] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:28.113945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d023563-2e90-4657-9c36-7b867822eff6 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:28.132496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:28.176767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d023563-2e90-4657-9c36-7b867822eff6 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:28.181300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:28.182164 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:28.182446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:28.182748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] PATH_INFO: `/v3/users/7104d843143d474fa7b674915532841d` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:28.183959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7104d843143d474fa7b674915532841d)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:28.185886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:28.232809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7104d843143d474fa7b674915532841d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.240337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7104d843143d474fa7b674915532841d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.241034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7104d843143d474fa7b674915532841d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.241670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7104d843143d474fa7b674915532841d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.248629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7104d843143d474fa7b674915532841d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.265853 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1292/2570] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:16:28 2022] DELETE /identity/v3/users/7104d843143d474fa7b674915532841d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:28.270810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:28.271624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:28.271741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:28.289607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:28.290823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:28.349414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1279/2571] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:28.359002 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:28.360633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:28.419159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7fdc6-28a5-4a62-b302-a61d375ad525 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:28.422947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920e2d2-f624-4a1c-ad4c-7c6a9e841a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:28.423618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920e2d2-f624-4a1c-ad4c-7c6a9e841a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:28.423906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920e2d2-f624-4a1c-ad4c-7c6a9e841a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:28.424182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920e2d2-f624-4a1c-ad4c-7c6a9e841a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:28.433185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920e2d2-f624-4a1c-ad4c-7c6a9e841a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:28.434626 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920e2d2-f624-4a1c-ad4c-7c6a9e841a3e service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:28.444786 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1293/2572] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:16:28.712593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:28.714033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:28.728291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73171-02f3-407f-8789-2d1cc3db213a None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:28.733518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:28.734598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:28.734849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:28.735134 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] PATH_INFO: `/v3/projects/02d20717df98496ab6dc58643e896933` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:28.736366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d20717df98496ab6dc58643e896933)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:28.738523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:28.786210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d20717df98496ab6dc58643e896933', 'request_id': 'req-6c011a1a-c15a-48cd-be35-b73a7b99bef8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.793599 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d20717df98496ab6dc58643e896933', 'request_id': 'req-6c011a1a-c15a-48cd-be35-b73a7b99bef8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.799731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d20717df98496ab6dc58643e896933', 'request_id': 'req-6c011a1a-c15a-48cd-be35-b73a7b99bef8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.811623 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] The token cache is being invalidate because project 02d20717df98496ab6dc58643e896933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:16:28.811917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.812564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:16:28.814126 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1280/2573] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:16:28 2022] DELETE /identity/v3/projects/02d20717df98496ab6dc58643e896933 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:16:38.440138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:38.808528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:16:54.861984 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad16a72-ace3-4841-9fdd-2c3dad2aea08 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:54.862496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad16a72-ace3-4841-9fdd-2c3dad2aea08 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:54.862615 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad16a72-ace3-4841-9fdd-2c3dad2aea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:54.880816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9ad16a72-ace3-4841-9fdd-2c3dad2aea08 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:16:54.882027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9ad16a72-ace3-4841-9fdd-2c3dad2aea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:54.941301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1294/2574] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:16:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:16:54.995246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:16:54.996699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:16:55.068609 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c011a1a-c15a-48cd-be35-b73a7b99bef8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:16:55.073538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1cec2-c7f1-4b69-a52c-a9e77e7c123c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:16:55.074190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1cec2-c7f1-4b69-a52c-a9e77e7c123c service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:16:55.074474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1cec2-c7f1-4b69-a52c-a9e77e7c123c service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:16:55.074759 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1cec2-c7f1-4b69-a52c-a9e77e7c123c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:16:55.082773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1cec2-c7f1-4b69-a52c-a9e77e7c123c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:16:55.084382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1cec2-c7f1-4b69-a52c-a9e77e7c123c service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:16:55.092403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1281/2575] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:16:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:17:04.934506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=25 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:05.089197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=32 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:08.591451 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c253a8-4309-4684-ae44-54f8a194cf10 None None] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:08.592031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c253a8-4309-4684-ae44-54f8a194cf10 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:08.592031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c253a8-4309-4684-ae44-54f8a194cf10 None None] PATH_INFO: `/` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:08.593558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1295/2576] 10.222.0.78 () {54 vars in 921 bytes} [Mon Jul 4 10:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 10:17:08.599857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f4c2-1202-4158-8790-ac0a903e5e3f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:08.600375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f4c2-1202-4158-8790-ac0a903e5e3f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:08.600475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f4c2-1202-4158-8790-ac0a903e5e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:08.623310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4989f4c2-1202-4158-8790-ac0a903e5e3f None None] MFA Rules not processed for user `3a63afc7b9514ef7b4d799b1c1538b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:08.624552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4989f4c2-1202-4158-8790-ac0a903e5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:08.701065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1282/2577] 10.222.0.78 () {58 vars in 1018 bytes} [Mon Jul 4 10:17:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:17:08.712314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c253a8-4309-4684-ae44-54f8a194cf10 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:08.714094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c6c253a8-4309-4684-ae44-54f8a194cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:08.776761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c253a8-4309-4684-ae44-54f8a194cf10 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:08.780387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:08.781125 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:08.781405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:08.781674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:08.794418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:08.795416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:08.807877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1296/2578] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:17:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:17:10.574878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:10.575354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:10.575461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:10.594168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:10.595372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:10.602543 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1283/2579] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:17:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:17:10.614376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:10.625718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a750c0a-7383-473d-94ae-056e32661bd9 service glance] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:10.631300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926b4da-c4c0-4670-b90b-066377dc9f0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:10.631989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b4da-c4c0-4670-b90b-066377dc9f0e service swift] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:10.632275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b4da-c4c0-4670-b90b-066377dc9f0e service swift] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:10.632553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b4da-c4c0-4670-b90b-066377dc9f0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:10.640623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926b4da-c4c0-4670-b90b-066377dc9f0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:10.642191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926b4da-c4c0-4670-b90b-066377dc9f0e service swift] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:10.651175 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1297/2580] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:17:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:17:20.589223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=34 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:20.647882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=32 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:28.353202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:28.354725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:28.423295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1c4c-f6f8-44c0-bd76-f791c4e423eb None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:28.427088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:28.427773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:28.428059 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:28.428335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:28.430129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:28.505826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:28.507756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:28.520624 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1284/2581] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:17:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:17:32.220425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e264-f64e-4509-b579-42a3996e3e8a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:32.220922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e264-f64e-4509-b579-42a3996e3e8a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:32.221034 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39e264-f64e-4509-b579-42a3996e3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:32.239800 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-2e39e264-f64e-4509-b579-42a3996e3e8a None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:32.240995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2e39e264-f64e-4509-b579-42a3996e3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:32.248171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1298/2582] 10.222.0.78 () {58 vars in 967 bytes} [Mon Jul 4 10:17:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:17:32.263647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:32.276120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4dfc-9e86-44ec-95ca-fd28caa1e9d8 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:32.281613 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:32.282266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:32.282539 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:32.282816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:32.292006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:32.293588 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:32.302065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1285/2583] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:17:35.638751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e264-f64e-4509-b579-42a3996e3e8a None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:35.651365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39e264-f64e-4509-b579-42a3996e3e8a None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:35.655360 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:35.656054 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:35.656420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:35.656699 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:35.658507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:35.726425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:35.727916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:35.738144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1299/2584] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:17:42.299597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=54 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:42.696869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:42.698404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:42.782488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133a49e-f43d-4c8a-afc6-f3899e599890 service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:42.790801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:42.791765 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:42.792122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:42.792419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:42.794745 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:42.811211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:42.812617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:42.833202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1286/2585] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:17:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:17:42.880555 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:42.883646 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:42.900437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddb1e-27f2-43a1-a78b-7d7651673f34 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:42.905981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:42.907137 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:42.907481 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:42.907921 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] PATH_INFO: `/v3/users/48e1e1cbbcd744239db9dca573f93b1d` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:42.910963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e1e1cbbcd744239db9dca573f93b1d)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:42.914041 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:43.003797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e1e1cbbcd744239db9dca573f93b1d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.016645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e1e1cbbcd744239db9dca573f93b1d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.017487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e1e1cbbcd744239db9dca573f93b1d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.019227 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e1e1cbbcd744239db9dca573f93b1d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.028186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e1e1cbbcd744239db9dca573f93b1d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.051979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1300/2586] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:17:42 2022] DELETE /identity/v3/users/48e1e1cbbcd744239db9dca573f93b1d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:17:43.300572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:43.311816 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be917-a2e8-4e69-b5cf-65281713bdea service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:43.373399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:43.374275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:43.374560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:43.374838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] PATH_INFO: `/v3/projects/2694f227c556441581f8e5d4b69dff82` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:43.376104 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2694f227c556441581f8e5d4b69dff82)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:43.379344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:43.428439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2694f227c556441581f8e5d4b69dff82', 'request_id': 'req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.436131 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2694f227c556441581f8e5d4b69dff82', 'request_id': 'req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.442944 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2694f227c556441581f8e5d4b69dff82', 'request_id': 'req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.454433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] The token cache is being invalidate because project 2694f227c556441581f8e5d4b69dff82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:17:43.454729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.456019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.457571 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1287/2587] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:17:43 2022] DELETE /identity/v3/projects/2694f227c556441581f8e5d4b69dff82 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:17:43.461647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:43.463139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:43.477336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1667c0f-eb2a-4fbb-b379-1f33b0ce038b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:43.535792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:43.536678 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:43.536962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:43.537241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] PATH_INFO: `/v3/users/3a22365e52e148d692d53d5ff73e4c62` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:43.538437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a22365e52e148d692d53d5ff73e4c62)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:43.540420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:43.541881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:43.593158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a22365e52e148d692d53d5ff73e4c62'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.600368 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a22365e52e148d692d53d5ff73e4c62'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.601025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a22365e52e148d692d53d5ff73e4c62'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.601660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a22365e52e148d692d53d5ff73e4c62'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.608785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a22365e52e148d692d53d5ff73e4c62'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.625756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1301/2588] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:17:43 2022] DELETE /identity/v3/users/3a22365e52e148d692d53d5ff73e4c62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:17:43.798595 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:43.800848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:43.814338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e93489-6e6f-4ed4-a2f5-603b2c6abcf4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:43.832605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:43.874460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:43.875332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:43.875647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:43.875925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] PATH_INFO: `/v3/projects/38842d0ab2fb4dbbad70a51ecf282f6e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:43.877942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38842d0ab2fb4dbbad70a51ecf282f6e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:43.879865 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:43.925010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38842d0ab2fb4dbbad70a51ecf282f6e', 'request_id': 'req-4af3c5de-eaa1-4564-a11a-0daf08c8078c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.932099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38842d0ab2fb4dbbad70a51ecf282f6e', 'request_id': 'req-4af3c5de-eaa1-4564-a11a-0daf08c8078c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.937758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38842d0ab2fb4dbbad70a51ecf282f6e', 'request_id': 'req-4af3c5de-eaa1-4564-a11a-0daf08c8078c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.949264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] The token cache is being invalidate because project 38842d0ab2fb4dbbad70a51ecf282f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:17:43.949554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.950186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:43.951754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1288/2589] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:17:43 2022] DELETE /identity/v3/projects/38842d0ab2fb4dbbad70a51ecf282f6e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:17:46.720520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:46.721942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:46.779241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95a38-f04f-4feb-80a2-1fdbaccaba8d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:46.830307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:46.830960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:46.831240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:46.831513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:46.833359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:46.880879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:46.898281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:46.899788 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:46.910618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1302/2590] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:17:50.051531 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.053055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:50.066566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3c5de-eaa1-4564-a11a-0daf08c8078c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.071099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.072026 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.072308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.072610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] PATH_INFO: `/v3/users/ab81044ba8c54e8d808c4aed5a659929` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.073785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab81044ba8c54e8d808c4aed5a659929)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.075792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.122474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab81044ba8c54e8d808c4aed5a659929'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.123163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab81044ba8c54e8d808c4aed5a659929'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.130419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab81044ba8c54e8d808c4aed5a659929'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.137618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab81044ba8c54e8d808c4aed5a659929'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.138244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-ac812cd3-19b6-47f1-a005-34b972f6bf06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab81044ba8c54e8d808c4aed5a659929'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.156079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1289/2591] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:17:50 2022] DELETE /identity/v3/users/ab81044ba8c54e8d808c4aed5a659929 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:17:50.338387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.351413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e888377-8dff-4cbf-b96d-b80d0e54adfa service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.414001 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.414971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.415254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.415559 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] PATH_INFO: `/v3/projects/b325c904880846668c079d009e709085` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.416775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b325c904880846668c079d009e709085)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.418716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.464944 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b325c904880846668c079d009e709085', 'request_id': 'req-53d8ac13-864e-4068-a874-4e01e2e9a2d1'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.471963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b325c904880846668c079d009e709085', 'request_id': 'req-53d8ac13-864e-4068-a874-4e01e2e9a2d1'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.477629 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b325c904880846668c079d009e709085', 'request_id': 'req-53d8ac13-864e-4068-a874-4e01e2e9a2d1'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.490250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] The token cache is being invalidate because project b325c904880846668c079d009e709085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:17:50.490541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.491161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-53d8ac13-864e-4068-a874-4e01e2e9a2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:17:50.492745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1303/2592] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:17:50 2022] DELETE /identity/v3/projects/b325c904880846668c079d009e709085 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:17:50.497641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d45490-0d65-404f-a671-29fa513b987d None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.497939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d45490-0d65-404f-a671-29fa513b987d None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.498227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d45490-0d65-404f-a671-29fa513b987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.516349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-19d45490-0d65-404f-a671-29fa513b987d None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:50.518070 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-19d45490-0d65-404f-a671-29fa513b987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:50.535730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:50.578153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1290/2593] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:17:50.587038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031232d-6740-47ef-a393-241ccfa71d76 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.587266 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031232d-6740-47ef-a393-241ccfa71d76 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.587550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031232d-6740-47ef-a393-241ccfa71d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.609127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c031232d-6740-47ef-a393-241ccfa71d76 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:50.609127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c031232d-6740-47ef-a393-241ccfa71d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:50.617202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1304/2594] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:17:50.621356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d45490-0d65-404f-a671-29fa513b987d None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.631197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d45490-0d65-404f-a671-29fa513b987d None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.635959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.636620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.636902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.637179 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.637924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:17:50.638230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.639835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.652288 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1291/2595] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:17:50.656614 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031232d-6740-47ef-a393-241ccfa71d76 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.666792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031232d-6740-47ef-a393-241ccfa71d76 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.671754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.672413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.672704 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.672983 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.673716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.675689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.703166 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1305/2596] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:17:50 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:17:50.707412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.717766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6629b-967a-47ec-87ab-5f050a2c1a26 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.774451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.775122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.775407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.775719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.776404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.778317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.798400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1292/2597] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:17:50 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:17:50.802566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.813099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072fe05-a58f-4e83-b3b8-7cab2ca2ec7f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.817791 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.818447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.818734 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.819013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.819789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.821391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.832648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1306/2598] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:17:50.836405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.847717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773eac-fbcb-450c-aee7-cd3f0384c335 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.852606 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32112d-a80f-4aec-a4b3-9f96bf4dd1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.853275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32112d-a80f-4aec-a4b3-9f96bf4dd1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.853566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32112d-a80f-4aec-a4b3-9f96bf4dd1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.853836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32112d-a80f-4aec-a4b3-9f96bf4dd1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.854677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32112d-a80f-4aec-a4b3-9f96bf4dd1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.856291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32112d-a80f-4aec-a4b3-9f96bf4dd1e8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.866832 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1293/2599] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:17:50.871108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:50.882902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9521c-8e10-4ab1-a0f1-07de5f25815a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:50.888466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:50.889366 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.889653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.889936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] PATH_INFO: `/v3/projects/4830264311074d689358e7b036f578ae/users/248adc39e0f84362b814deae09cdace0/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.905716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4830264311074d689358e7b036f578ae, user_id=248adc39e0f84362b814deae09cdace0, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:50.908478 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:50.922328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1307/2600] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:17:50 2022] PUT /identity/v3/projects/4830264311074d689358e7b036f578ae/users/248adc39e0f84362b814deae09cdace0/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:17:50.927661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d38f-47af-4709-86ca-415046b265dd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:50.927956 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d38f-47af-4709-86ca-415046b265dd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:50.928236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d38f-47af-4709-86ca-415046b265dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:50.947384 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8375d38f-47af-4709-86ca-415046b265dd None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:50.948604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8375d38f-47af-4709-86ca-415046b265dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:51.009738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1294/2601] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:17:51.020219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:51.021913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:51.035439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:51.081192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45766a47-4938-4bc9-8ed1-0c885d302d26 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:51.084830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:51.085491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:51.085770 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:51.086069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:51.095455 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:51.096855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:51.106216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1308/2602] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:17:55.158551 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c68bf-23be-4bb8-b123-7bab8800c7cd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:55.159052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c68bf-23be-4bb8-b123-7bab8800c7cd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:55.159205 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c68bf-23be-4bb8-b123-7bab8800c7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:55.188999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bc8c68bf-23be-4bb8-b123-7bab8800c7cd None None] MFA Rules not processed for user `248adc39e0f84362b814deae09cdace0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:55.190232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bc8c68bf-23be-4bb8-b123-7bab8800c7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:55.209687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:17:55.269253 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1295/2603] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:17:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:17:55.283747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:17:55.285222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:55.363205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77cb99-4139-44f7-912c-e9f1855084df service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:17:55.369484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:17:55.370101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:55.370391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:55.370837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:55.380102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:17:55.381756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:17:55.391658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1309/2604] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:17:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:17:56.673090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:17:56.673566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:17:56.673703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:17:56.692728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] MFA Rules not processed for user `248adc39e0f84362b814deae09cdace0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:17:56.693954 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:17:56.701229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1296/2605] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:05.387017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=55 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:06.687091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=22 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:31.294815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:31.296261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:31.369144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb680-4730-441c-bfda-b7cbd51495de service nova] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:31.374592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:31.375237 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:31.375516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:31.375819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:31.378135 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:31.390286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:31.391936 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:31.403619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1310/2606] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:18:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:18:36.084041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:36.085452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:36.097338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1c3f-5704-45f2-b24d-2ae9d799aa5f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:36.100919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:36.101560 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:36.101844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:36.102123 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:36.103841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:36.116596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:36.118783 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:36.129115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1297/2607] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:18:39.238059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:39.240377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:39.257104 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356aaaf0-c498-4ffe-a28b-bcb6f5673204 service placement] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:39.261916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:39.262843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.263162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.263512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] PATH_INFO: `/v3/users/0c3d791666e742e4915d4f52d8dbe03b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.264763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3d791666e742e4915d4f52d8dbe03b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:39.266710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:39.316578 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3d791666e742e4915d4f52d8dbe03b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.324914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3d791666e742e4915d4f52d8dbe03b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.325535 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3d791666e742e4915d4f52d8dbe03b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.326165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3d791666e742e4915d4f52d8dbe03b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.333695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2fff1bb3-a0ef-44e3-be87-5dc53fbcf988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3d791666e742e4915d4f52d8dbe03b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.351132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1311/2608] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:18:39 2022] DELETE /identity/v3/users/0c3d791666e742e4915d4f52d8dbe03b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:39.523502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:39.534427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7ec7-1e8d-4e46-9c9b-c96f5a16aaf2 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:39.593191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:39.594067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.594352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.594630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] PATH_INFO: `/v3/projects/05196cf3447a4e17ac06976291ac4c92` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.595870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05196cf3447a4e17ac06976291ac4c92)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:39.597761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:39.646258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05196cf3447a4e17ac06976291ac4c92', 'request_id': 'req-e10f8a75-60b3-4405-8bc9-3c9724b2426c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.653058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05196cf3447a4e17ac06976291ac4c92', 'request_id': 'req-e10f8a75-60b3-4405-8bc9-3c9724b2426c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.658526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05196cf3447a4e17ac06976291ac4c92', 'request_id': 'req-e10f8a75-60b3-4405-8bc9-3c9724b2426c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.670091 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] The token cache is being invalidate because project 05196cf3447a4e17ac06976291ac4c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:18:39.670412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.671052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e10f8a75-60b3-4405-8bc9-3c9724b2426c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:39.672669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1298/2609] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:18:39 2022] DELETE /identity/v3/projects/05196cf3447a4e17ac06976291ac4c92 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:39.677542 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12b68-da83-4327-8324-5878a8a08662 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.677843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12b68-da83-4327-8324-5878a8a08662 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.678118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f12b68-da83-4327-8324-5878a8a08662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.695910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-34f12b68-da83-4327-8324-5878a8a08662 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:39.697102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-34f12b68-da83-4327-8324-5878a8a08662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:39.756179 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1312/2610] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:39.763910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ba08-179f-4482-a54e-06747c49308c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.764237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ba08-179f-4482-a54e-06747c49308c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.764526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ba08-179f-4482-a54e-06747c49308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.783378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1c74ba08-179f-4482-a54e-06747c49308c None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:39.784627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1c74ba08-179f-4482-a54e-06747c49308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:39.792577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1299/2611] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:39.796661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12b68-da83-4327-8324-5878a8a08662 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:39.801495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:39.807879 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f12b68-da83-4327-8324-5878a8a08662 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:39.814780 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:39.815442 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.815772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.816049 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.816784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:18:39.817093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:39.818787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:39.831043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1313/2612] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:18:39.835372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ba08-179f-4482-a54e-06747c49308c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:39.844684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ba08-179f-4482-a54e-06747c49308c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:39.849416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:39.850073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.850361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.850723 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.851452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:39.853419 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:39.879139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1300/2613] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:18:39 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:18:39.883459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:39.894409 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4624e-1dec-4737-ada6-6c81a0abb6b8 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:39.949580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:39.950240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.950522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.950799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.951482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:39.953435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:39.972091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1314/2614] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:18:39 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:18:39.976159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:39.987291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48b740-d0ed-49b9-a4e5-c5b980840e37 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:39.992430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:39.993090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:39.993378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:39.993660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:39.994396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:39.996061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.007067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1301/2615] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:40.010821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.021129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374532e-291d-4d23-bd9f-a919c73af445 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.025811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd778-8db9-4011-8415-4cbbe2f5f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.026463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd778-8db9-4011-8415-4cbbe2f5f414 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.026749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd778-8db9-4011-8415-4cbbe2f5f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.027036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd778-8db9-4011-8415-4cbbe2f5f414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.027832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd778-8db9-4011-8415-4cbbe2f5f414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.029432 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd778-8db9-4011-8415-4cbbe2f5f414 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.039276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1315/2616] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:40.043242 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.053973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfefc6-1529-4429-bac4-358c7560e230 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.058583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.059461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.059772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.060067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] PATH_INFO: `/v3/projects/adc68261bf5d4209bed242151352e081/users/c7da7f689dd344069e8ddcaa756fbb22/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.075810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc68261bf5d4209bed242151352e081, user_id=c7da7f689dd344069e8ddcaa756fbb22, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.078416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.090672 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1302/2617] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:18:40 2022] PUT /identity/v3/projects/adc68261bf5d4209bed242151352e081/users/c7da7f689dd344069e8ddcaa756fbb22/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:18:40.100782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268abd4e-940f-4134-a739-36d8371eb3c2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.101078 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268abd4e-940f-4134-a739-36d8371eb3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.101385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268abd4e-940f-4134-a739-36d8371eb3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.128556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-268abd4e-940f-4134-a739-36d8371eb3c2 None None] MFA Rules not processed for user `c7da7f689dd344069e8ddcaa756fbb22`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:40.129757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-268abd4e-940f-4134-a739-36d8371eb3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:40.194737 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1316/2618] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:40.199227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.212517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:40.262506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce53bc-2eee-4bb1-beed-9adb03c76ffd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.267307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.268284 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.268570 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.268852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.269549 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.271506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.296905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1303/2619] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:18:40 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:18:40.301525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268abd4e-940f-4134-a739-36d8371eb3c2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.312439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268abd4e-940f-4134-a739-36d8371eb3c2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.362710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:40.369355 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.370026 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.370313 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.370856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.371909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.373871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.393240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1317/2620] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:18:40 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:18:40.397295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.408074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc722fc-cbae-4115-bd7f-bb067a6037ed admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.412684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.413346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.413632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.413910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.414636 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.416272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.427286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1304/2621] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:40.431341 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.441564 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265009d-7a37-40e6-89ab-9761ef4eedde admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.446174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.447065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.447340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.447643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] PATH_INFO: `/v3/projects/cba420cb6dbf4233a3011ef21306659c/users/e9d00419968944bbb5813f4c9091c45b/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.462669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba420cb6dbf4233a3011ef21306659c, user_id=e9d00419968944bbb5813f4c9091c45b, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.465456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.482711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1318/2622] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:18:40 2022] PUT /identity/v3/projects/cba420cb6dbf4233a3011ef21306659c/users/e9d00419968944bbb5813f4c9091c45b/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:40.487610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.497726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563b288-36e9-4fe9-9cbd-c077d816473d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.554133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267033cc-226d-4e4b-ab60-b16ac81dcb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.554789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267033cc-226d-4e4b-ab60-b16ac81dcb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.555004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267033cc-226d-4e4b-ab60-b16ac81dcb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.555289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267033cc-226d-4e4b-ab60-b16ac81dcb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.556053 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267033cc-226d-4e4b-ab60-b16ac81dcb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.557650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267033cc-226d-4e4b-ab60-b16ac81dcb16 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.567797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1305/2623] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:40.572778 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.583374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0002555-f74e-470b-a83e-b0ed4c1ab8c8 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.588097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.588972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.589248 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.589520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] PATH_INFO: `/v3/projects/cba420cb6dbf4233a3011ef21306659c/users/e9d00419968944bbb5813f4c9091c45b/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.591472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba420cb6dbf4233a3011ef21306659c, user_id=e9d00419968944bbb5813f4c9091c45b, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.594123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.605141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1319/2624] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:18:40 2022] PUT /identity/v3/projects/cba420cb6dbf4233a3011ef21306659c/users/e9d00419968944bbb5813f4c9091c45b/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:40.617172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3795a-c163-4d9a-a7b4-574105a366fd None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.617467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3795a-c163-4d9a-a7b4-574105a366fd None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.617776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3795a-c163-4d9a-a7b4-574105a366fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.644592 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-8ff3795a-c163-4d9a-a7b4-574105a366fd None None] MFA Rules not processed for user `e9d00419968944bbb5813f4c9091c45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:40.645799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8ff3795a-c163-4d9a-a7b4-574105a366fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:40.716155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1306/2625] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:40.727530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:40.729254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:40.786274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78462291-60dc-4a7c-8a82-de87e280e9c9 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:40.789986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:40.790628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:40.790917 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:40.791214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:40.858538 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:40.860047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:40.869122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1320/2626] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:18:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:18:43.403633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3795a-c163-4d9a-a7b4-574105a366fd None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:43.413224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3795a-c163-4d9a-a7b4-574105a366fd None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:43.417057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c7f88-c636-45b2-a523-cb413e89779c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:43.417702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c7f88-c636-45b2-a523-cb413e89779c service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:43.417985 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c7f88-c636-45b2-a523-cb413e89779c service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:43.418262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c7f88-c636-45b2-a523-cb413e89779c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:43.425226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:43.427969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c7f88-c636-45b2-a523-cb413e89779c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:43.429848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c7f88-c636-45b2-a523-cb413e89779c service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:43.440934 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1307/2627] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:18:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:18:50.864966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=66,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:53.436665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:55.863329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:55.928871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140443f-5531-4aca-b8c7-3205e9247200 service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:55.933534 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:55.934397 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:55.934677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:55.934954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] PATH_INFO: `/v3/users/c7da7f689dd344069e8ddcaa756fbb22` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:55.936182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7da7f689dd344069e8ddcaa756fbb22)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:55.938151 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:55.985654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7da7f689dd344069e8ddcaa756fbb22'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:55.993522 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7da7f689dd344069e8ddcaa756fbb22'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:55.994208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7da7f689dd344069e8ddcaa756fbb22'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:55.994929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7da7f689dd344069e8ddcaa756fbb22'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.002212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7da7f689dd344069e8ddcaa756fbb22'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.019906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1321/2628] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:18:55 2022] DELETE /identity/v3/users/c7da7f689dd344069e8ddcaa756fbb22 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:56.024475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:56.024970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:56.025081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:56.042846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:56.044098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:56.103095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1308/2629] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:56.117470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:56.118852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:56.174645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c4899-3a2f-4955-911d-5ceed77be51a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:56.178972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:56.179644 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:56.179925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:56.180194 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:56.189290 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:56.190738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:56.200567 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1322/2630] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:18:56.470814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:56.472817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:56.484878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097c3a1-9505-4665-a369-a684f1c01aa2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:56.489846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:56.490711 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:56.490997 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:56.491271 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] PATH_INFO: `/v3/projects/adc68261bf5d4209bed242151352e081` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:56.492475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc68261bf5d4209bed242151352e081)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:56.494387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:56.542758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc68261bf5d4209bed242151352e081', 'request_id': 'req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.550200 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc68261bf5d4209bed242151352e081', 'request_id': 'req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.556035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc68261bf5d4209bed242151352e081', 'request_id': 'req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.573022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] The token cache is being invalidate because project adc68261bf5d4209bed242151352e081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:18:56.573515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.574525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.576371 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1309/2631] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:18:56 2022] DELETE /identity/v3/projects/adc68261bf5d4209bed242151352e081 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:56.580244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:56.590628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12ced2-a956-4a20-a2a1-092f194a8279 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:56.609007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:56.648218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:56.649008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:56.649291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:56.649566 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] PATH_INFO: `/v3/users/e9d00419968944bbb5813f4c9091c45b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:56.650773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d00419968944bbb5813f4c9091c45b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:56.652759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:56.700761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d00419968944bbb5813f4c9091c45b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.708035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d00419968944bbb5813f4c9091c45b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.708649 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d00419968944bbb5813f4c9091c45b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.709255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d00419968944bbb5813f4c9091c45b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.716304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-5f533064-42cc-44ad-9ae7-d25b99344b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d00419968944bbb5813f4c9091c45b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:56.733964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1323/2632] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:18:56 2022] DELETE /identity/v3/users/e9d00419968944bbb5813f4c9091c45b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:18:57.004877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.006411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:57.020550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9dc5c-fa82-44f3-84a5-813ea8eddc4e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.079352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.080265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.080548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.080825 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] PATH_INFO: `/v3/projects/cba420cb6dbf4233a3011ef21306659c` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.082032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba420cb6dbf4233a3011ef21306659c)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.083970 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.115270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:57.133199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba420cb6dbf4233a3011ef21306659c', 'request_id': 'req-539554ea-48ce-41f1-ae3e-a9c339c16c14'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:57.140836 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba420cb6dbf4233a3011ef21306659c', 'request_id': 'req-539554ea-48ce-41f1-ae3e-a9c339c16c14'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:57.147488 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba420cb6dbf4233a3011ef21306659c', 'request_id': 'req-539554ea-48ce-41f1-ae3e-a9c339c16c14'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:57.164071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] The token cache is being invalidate because project cba420cb6dbf4233a3011ef21306659c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:18:57.164364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:57.165133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-539554ea-48ce-41f1-ae3e-a9c339c16c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:18:57.167486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1310/2633] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:18:57 2022] DELETE /identity/v3/projects/cba420cb6dbf4233a3011ef21306659c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:57.173750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3615b9-1a69-4fe0-af56-8620c57b35d2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.174224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3615b9-1a69-4fe0-af56-8620c57b35d2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.174435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3615b9-1a69-4fe0-af56-8620c57b35d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.193255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9e3615b9-1a69-4fe0-af56-8620c57b35d2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:57.194573 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9e3615b9-1a69-4fe0-af56-8620c57b35d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:57.253433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1324/2634] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:57.261366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ca8eb-c936-4690-8de6-7cefd68b3f62 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.261662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ca8eb-c936-4690-8de6-7cefd68b3f62 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.261946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ca8eb-c936-4690-8de6-7cefd68b3f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.280932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-536ca8eb-c936-4690-8de6-7cefd68b3f62 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:57.282148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-536ca8eb-c936-4690-8de6-7cefd68b3f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:57.290881 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1311/2635] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:57.295086 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3615b9-1a69-4fe0-af56-8620c57b35d2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.304658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3615b9-1a69-4fe0-af56-8620c57b35d2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.309433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.310097 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.310413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.310713 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.311473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:18:57.311828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.313458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.325214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1325/2636] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:18:57.329346 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ca8eb-c936-4690-8de6-7cefd68b3f62 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.339263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ca8eb-c936-4690-8de6-7cefd68b3f62 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.344033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.344689 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.344977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.345263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.345964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.348484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.374264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1312/2637] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:18:57 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:18:57.378686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.389010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2a932-7dd2-4349-940c-6a98ed2d2e2d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.415633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:57.447489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.448128 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.448416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.448697 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.449403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.451333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.471285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1326/2638] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:18:57 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:18:57.476042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.487112 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f1c36-666e-481d-8cd7-a78c214da49a admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.491835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.492540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.492811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.493089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.493822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.495407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.506841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1313/2639] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:57.510887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.521801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669c60d-0905-485c-a14f-2e195592a6b3 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.526547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a57d-63c3-4354-b76a-b7827bf387cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.527199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a57d-63c3-4354-b76a-b7827bf387cb admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.527482 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a57d-63c3-4354-b76a-b7827bf387cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.527808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a57d-63c3-4354-b76a-b7827bf387cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.528531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748a57d-63c3-4354-b76a-b7827bf387cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.530126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748a57d-63c3-4354-b76a-b7827bf387cb admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.542011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1327/2640] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:57.546057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.556247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51520-821d-41f3-9b07-38e65eedab41 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.560932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.561829 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.562113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.562389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] PATH_INFO: `/v3/projects/7f7967fd5a254d3f806dac3c7edb8e2b/users/4a7b176280d946998a02feb0b711d3d8/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.578243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7967fd5a254d3f806dac3c7edb8e2b, user_id=4a7b176280d946998a02feb0b711d3d8, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.581602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.594461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1314/2641] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:18:57 2022] PUT /identity/v3/projects/7f7967fd5a254d3f806dac3c7edb8e2b/users/4a7b176280d946998a02feb0b711d3d8/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:57.599523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507fb35-34d2-47a9-8b5a-bf5c4bb18e8b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.599848 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507fb35-34d2-47a9-8b5a-bf5c4bb18e8b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.600129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507fb35-34d2-47a9-8b5a-bf5c4bb18e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.617163 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-8507fb35-34d2-47a9-8b5a-bf5c4bb18e8b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:57.618385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-8507fb35-34d2-47a9-8b5a-bf5c4bb18e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:57.675960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1328/2642] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:57.685726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:57.687411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:57.743760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088265-e1c9-4852-b68b-e2f72081b82b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:57.747485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:57.748161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:57.748448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:57.748727 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:57.758379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:57.759833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:57.770463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1315/2643] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:18:58.391731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468de1b-cfcc-4631-85c5-ee608277c49e None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:58.392223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468de1b-cfcc-4631-85c5-ee608277c49e None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:58.392223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468de1b-cfcc-4631-85c5-ee608277c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:58.418738 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-9468de1b-cfcc-4631-85c5-ee608277c49e None None] MFA Rules not processed for user `4a7b176280d946998a02feb0b711d3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:58.419982 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9468de1b-cfcc-4631-85c5-ee608277c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:58.486808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1329/2644] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:58.493368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:58.503669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a6c10-3310-461c-9da7-8858f813af53 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:58.508274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:58.508926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:58.509296 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:58.509533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:58.510236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:58.512165 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:58.547162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1316/2645] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:18:58 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:18:58.548507 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468de1b-cfcc-4631-85c5-ee608277c49e None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:58.573892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468de1b-cfcc-4631-85c5-ee608277c49e None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:58.612804 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:58.637066 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:58.637735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:58.638012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:58.638279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:58.638986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:58.640905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:58.661111 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1330/2646] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:18:58 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:18:58.664858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:58.676257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cddf53-12a8-45af-848c-d8f60573b410 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:58.680931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:58.681822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:58.682085 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:58.682363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:58.683260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:58.684889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:58.696351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1317/2647] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:58.700520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:58.710484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd2a9-2e43-4826-92e7-92e6289a59de admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:58.715098 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:58.716018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:58.716305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:58.716582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] PATH_INFO: `/v3/projects/14a6d28ead054b85a19eae3de5ff17cf/users/624c304296054eb9a6fd82c2ed6c4a29/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:58.731411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a6d28ead054b85a19eae3de5ff17cf, user_id=624c304296054eb9a6fd82c2ed6c4a29, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:58.734208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:58.747996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1331/2648] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:18:58 2022] PUT /identity/v3/projects/14a6d28ead054b85a19eae3de5ff17cf/users/624c304296054eb9a6fd82c2ed6c4a29/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:58.751942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:58.762664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd66c8-0d5d-4aaf-bcde-e32bead2ab36 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:58.779188 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:18:58.822942 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28bc93-54f6-4ed6-82c9-36530836d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:58.823647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28bc93-54f6-4ed6-82c9-36530836d5df admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:58.823937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28bc93-54f6-4ed6-82c9-36530836d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:58.824219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28bc93-54f6-4ed6-82c9-36530836d5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:58.824948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28bc93-54f6-4ed6-82c9-36530836d5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:58.826540 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28bc93-54f6-4ed6-82c9-36530836d5df admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:58.836302 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1318/2649] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:18:58.840759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:58.851045 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0baa-d49e-4d21-981c-d8880d6473fd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:58.856021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680eb1f-fae4-4d5c-b3de-b379a113dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:58.856904 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680eb1f-fae4-4d5c-b3de-b379a113dfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:58.857187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680eb1f-fae4-4d5c-b3de-b379a113dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:58.857461 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680eb1f-fae4-4d5c-b3de-b379a113dfbc admin admin] PATH_INFO: `/v3/projects/14a6d28ead054b85a19eae3de5ff17cf/users/624c304296054eb9a6fd82c2ed6c4a29/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:58.859424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680eb1f-fae4-4d5c-b3de-b379a113dfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a6d28ead054b85a19eae3de5ff17cf, user_id=624c304296054eb9a6fd82c2ed6c4a29, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:58.864152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680eb1f-fae4-4d5c-b3de-b379a113dfbc admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:58.873367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1332/2650] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:18:58 2022] PUT /identity/v3/projects/14a6d28ead054b85a19eae3de5ff17cf/users/624c304296054eb9a6fd82c2ed6c4a29/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:18:59.501687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:59.502232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:59.502232 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:59.530515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] MFA Rules not processed for user `624c304296054eb9a6fd82c2ed6c4a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:59.531844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:59.609587 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1319/2651] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:59.620473 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:59.621010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:59.621144 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:59.639641 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] MFA Rules not processed for user `4a7b176280d946998a02feb0b711d3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:18:59.640784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:59.698759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1333/2652] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:18:59.711589 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:18:59.713122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:18:59.788202 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dbe5c-7547-4a23-bb8b-c52a13dee07c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:18:59.793755 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:18:59.794409 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:18:59.794693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:18:59.794968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:18:59.803412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:18:59.805024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:18:59.813874 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1320/2653] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:18:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:09.692095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:09.809901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:12.484612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:12.486082 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:12.543329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe14d1-fa1d-48ed-a4b0-0b7eb062c611 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:12.546905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:12.547544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:12.547857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:12.548133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:12.557702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:12.559145 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:12.569521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1334/2654] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:22.564640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=26 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:32.060246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:32.124153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c4b3f-b1a3-4114-91c1-0ea406521776 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:32.129023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:32.130410 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:32.130692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:32.130965 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] PATH_INFO: `/v3/users/4a7b176280d946998a02feb0b711d3d8` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:32.132180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7b176280d946998a02feb0b711d3d8)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:32.134086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:32.180429 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7b176280d946998a02feb0b711d3d8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.181010 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7b176280d946998a02feb0b711d3d8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.188261 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7b176280d946998a02feb0b711d3d8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.195900 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7b176280d946998a02feb0b711d3d8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.196548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7b176280d946998a02feb0b711d3d8'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.214359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1321/2655] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:19:32 2022] DELETE /identity/v3/users/4a7b176280d946998a02feb0b711d3d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:32.402129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:32.413350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf788-8fc4-4906-89b6-d0233b62871e service cinder] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:32.470865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:32.471758 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:32.472043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:32.472307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] PATH_INFO: `/v3/projects/7f7967fd5a254d3f806dac3c7edb8e2b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:32.473517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7967fd5a254d3f806dac3c7edb8e2b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:32.475413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:32.521801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7967fd5a254d3f806dac3c7edb8e2b', 'request_id': 'req-b8224bf1-2878-43b9-9574-baa904caba29'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.527918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7967fd5a254d3f806dac3c7edb8e2b', 'request_id': 'req-b8224bf1-2878-43b9-9574-baa904caba29'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.533347 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7967fd5a254d3f806dac3c7edb8e2b', 'request_id': 'req-b8224bf1-2878-43b9-9574-baa904caba29'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.545127 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] The token cache is being invalidate because project 7f7967fd5a254d3f806dac3c7edb8e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:19:32.545448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.546090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.547711 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1335/2656] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:19:32 2022] DELETE /identity/v3/projects/7f7967fd5a254d3f806dac3c7edb8e2b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:32.552401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:32.553863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:32.567511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dfb20-087f-4974-ba9f-ef806be726f1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:32.624285 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:32.625177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:32.625453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:32.625726 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] PATH_INFO: `/v3/users/624c304296054eb9a6fd82c2ed6c4a29` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:32.626913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624c304296054eb9a6fd82c2ed6c4a29)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:32.628851 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:32.652000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:32.678065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624c304296054eb9a6fd82c2ed6c4a29'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.679095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624c304296054eb9a6fd82c2ed6c4a29'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.687350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624c304296054eb9a6fd82c2ed6c4a29'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.705407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624c304296054eb9a6fd82c2ed6c4a29'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.706558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cdea8f8b-ca44-41dc-b09f-c916b79b27c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624c304296054eb9a6fd82c2ed6c4a29'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:32.730690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1322/2657] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:19:32 2022] DELETE /identity/v3/users/624c304296054eb9a6fd82c2ed6c4a29 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:32.913765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:32.915357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:32.929600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224bf1-2878-43b9-9574-baa904caba29 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:32.985965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:32.986830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:32.987117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:32.987395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] PATH_INFO: `/v3/projects/14a6d28ead054b85a19eae3de5ff17cf` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:32.989191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a6d28ead054b85a19eae3de5ff17cf)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:32.991096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.027192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:33.041219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a6d28ead054b85a19eae3de5ff17cf', 'request_id': 'req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.047225 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a6d28ead054b85a19eae3de5ff17cf', 'request_id': 'req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.052660 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a6d28ead054b85a19eae3de5ff17cf', 'request_id': 'req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.065748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] The token cache is being invalidate because project 14a6d28ead054b85a19eae3de5ff17cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:19:33.066032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.066656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-59c8efa5-7e0b-48c5-98be-d8cd576ac8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.068216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1336/2658] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:19:32 2022] DELETE /identity/v3/projects/14a6d28ead054b85a19eae3de5ff17cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:33.073080 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3461f5-f5fb-42d0-a820-5fbe3f1377c7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.073573 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3461f5-f5fb-42d0-a820-5fbe3f1377c7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.073681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3461f5-f5fb-42d0-a820-5fbe3f1377c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.092317 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2f3461f5-f5fb-42d0-a820-5fbe3f1377c7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:33.093515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2f3461f5-f5fb-42d0-a820-5fbe3f1377c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:33.153204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1323/2659] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:33.161423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7da533-1b1d-4b81-a90b-1ad2c94e9fc2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.161714 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7da533-1b1d-4b81-a90b-1ad2c94e9fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.161997 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7da533-1b1d-4b81-a90b-1ad2c94e9fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.180117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-0d7da533-1b1d-4b81-a90b-1ad2c94e9fc2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:33.181335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0d7da533-1b1d-4b81-a90b-1ad2c94e9fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:33.189677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1337/2660] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:33.193866 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3461f5-f5fb-42d0-a820-5fbe3f1377c7 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.203839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3461f5-f5fb-42d0-a820-5fbe3f1377c7 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.208938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.209594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.209879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.210158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.210903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:19:33.211210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.212834 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.225120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1324/2661] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:19:33.229436 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7da533-1b1d-4b81-a90b-1ad2c94e9fc2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.238952 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7da533-1b1d-4b81-a90b-1ad2c94e9fc2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.243589 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.244265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.244544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.244813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.245494 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.247389 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.273499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1338/2662] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:19:33 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:33.277694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.288456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecc600-1f0e-43a9-a236-c952743d3e02 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.344703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.345380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.345670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.345952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.346648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.349257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.369491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1325/2663] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:19:33 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:33.373593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.384377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c452-149a-4c98-9ac6-c54c6c698f40 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.389158 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.389823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.390106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.390382 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.391139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.393053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.403945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1339/2664] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:19:33.407807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.418328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcc4c-5a0f-4350-9c5d-ce7271a33dff admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.423132 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41128-8d1a-49fb-8262-34215a068361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.423905 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41128-8d1a-49fb-8262-34215a068361 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.424342 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41128-8d1a-49fb-8262-34215a068361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.424789 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41128-8d1a-49fb-8262-34215a068361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.425526 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d41128-8d1a-49fb-8262-34215a068361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.427105 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d41128-8d1a-49fb-8262-34215a068361 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.437628 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1326/2665] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:33.441988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.452283 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a0df9-3cb2-454f-b91f-592845bdf14a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.456977 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.458489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.458776 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.459059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] PATH_INFO: `/v3/projects/a08cc6e470514e088038675acc2805af/users/a120844d1db74215bbf0582b747d061e/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.473419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08cc6e470514e088038675acc2805af, user_id=a120844d1db74215bbf0582b747d061e, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.476230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.489035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1340/2666] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:33 2022] PUT /identity/v3/projects/a08cc6e470514e088038675acc2805af/users/a120844d1db74215bbf0582b747d061e/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:33.499266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934d426-99d5-4e08-8f11-a675483c5567 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.499563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934d426-99d5-4e08-8f11-a675483c5567 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.499875 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934d426-99d5-4e08-8f11-a675483c5567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.507216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:33.529058 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3934d426-99d5-4e08-8f11-a675483c5567 None None] MFA Rules not processed for user `a120844d1db74215bbf0582b747d061e`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:33.530278 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3934d426-99d5-4e08-8f11-a675483c5567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:33.597533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1327/2667] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:33.608471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.610155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:33.667159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a616-3076-4774-8874-2f3655603f0c admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.670825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aacfd1-0ec6-4e37-a8e3-758b2e75c710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.671497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aacfd1-0ec6-4e37-a8e3-758b2e75c710 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.671813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aacfd1-0ec6-4e37-a8e3-758b2e75c710 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.672091 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aacfd1-0ec6-4e37-a8e3-758b2e75c710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.680905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aacfd1-0ec6-4e37-a8e3-758b2e75c710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.682349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aacfd1-0ec6-4e37-a8e3-758b2e75c710 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.692146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1341/2668] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:33.711658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934d426-99d5-4e08-8f11-a675483c5567 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.778493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934d426-99d5-4e08-8f11-a675483c5567 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:33.783663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:33.784999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.785642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.785869 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] PATH_INFO: `/v3/users/a120844d1db74215bbf0582b747d061e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.787923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a120844d1db74215bbf0582b747d061e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:33.790931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:33.843347 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a120844d1db74215bbf0582b747d061e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.844052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a120844d1db74215bbf0582b747d061e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.852177 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a120844d1db74215bbf0582b747d061e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.859542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a120844d1db74215bbf0582b747d061e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.860238 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a120844d1db74215bbf0582b747d061e'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:33.880762 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1328/2669] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:19:33 2022] DELETE /identity/v3/users/a120844d1db74215bbf0582b747d061e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:33.885747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:33.886080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:33.886356 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:33.905536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:33.906747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:33.961391 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:33.975942 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1342/2670] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:19:33.985553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:33.987137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:34.003243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:34.053958 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29577710-7aae-4452-9073-7165ec67158b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:34.058048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2538-71f5-4550-a5c8-dd1a6c4586fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:34.058805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2538-71f5-4550-a5c8-dd1a6c4586fe service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:34.059135 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2538-71f5-4550-a5c8-dd1a6c4586fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:34.059484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2538-71f5-4550-a5c8-dd1a6c4586fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:34.070224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2538-71f5-4550-a5c8-dd1a6c4586fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:34.071756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2538-71f5-4550-a5c8-dd1a6c4586fe service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:34.081844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1329/2671] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:34.798172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:34.799682 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:34.811963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1213-acd8-4135-bc7a-8cf896e97bcc None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:34.827286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:34.828273 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:34.828502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:34.828782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] PATH_INFO: `/v3/projects/a08cc6e470514e088038675acc2805af` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:34.830754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08cc6e470514e088038675acc2805af)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:34.833285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:34.884314 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08cc6e470514e088038675acc2805af', 'request_id': 'req-e00256bd-b72f-48b3-a986-366d53d84b12'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:34.892060 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08cc6e470514e088038675acc2805af', 'request_id': 'req-e00256bd-b72f-48b3-a986-366d53d84b12'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:34.900117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08cc6e470514e088038675acc2805af', 'request_id': 'req-e00256bd-b72f-48b3-a986-366d53d84b12'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:34.914806 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] The token cache is being invalidate because project a08cc6e470514e088038675acc2805af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:19:34.915103 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:34.915783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e00256bd-b72f-48b3-a986-366d53d84b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:34.917348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1343/2672] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:19:34 2022] DELETE /identity/v3/projects/a08cc6e470514e088038675acc2805af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:34.922525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171ba4-5cda-4b49-845b-cafdb054f699 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:34.922895 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171ba4-5cda-4b49-845b-cafdb054f699 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:34.923184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171ba4-5cda-4b49-845b-cafdb054f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:34.942508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-24171ba4-5cda-4b49-845b-cafdb054f699 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:34.943803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-24171ba4-5cda-4b49-845b-cafdb054f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:35.005335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1330/2673] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:35.013134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51b96d-c7ce-4cd5-bdf8-3c95c20c4d84 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.013424 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51b96d-c7ce-4cd5-bdf8-3c95c20c4d84 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.013705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51b96d-c7ce-4cd5-bdf8-3c95c20c4d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.033174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-4e51b96d-c7ce-4cd5-bdf8-3c95c20c4d84 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:35.034394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-4e51b96d-c7ce-4cd5-bdf8-3c95c20c4d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:35.042741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1344/2674] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:35.047061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24171ba4-5cda-4b49-845b-cafdb054f699 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.057406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24171ba4-5cda-4b49-845b-cafdb054f699 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.062137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.062796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.063081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.063360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.064122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:19:35.064464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.066973 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.081191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1331/2675] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:19:35.086346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51b96d-c7ce-4cd5-bdf8-3c95c20c4d84 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.096063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51b96d-c7ce-4cd5-bdf8-3c95c20c4d84 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.101609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.102274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.102667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.102964 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.103716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.105785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.137403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1345/2676] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:35.138537 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.155653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0cce-95c9-43ac-ac1c-40020fe941a8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.215226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.215953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.216239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.216541 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.217243 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.219308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.240373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1332/2677] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:35.244580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.255074 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173155-e420-4837-9d7f-b51a37a81a52 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.261276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.261951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.262281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.262513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.263250 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.264896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.276527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1346/2678] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:35.280701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.291532 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558d41-1461-465a-857e-a57bf78c8f33 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.297223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069d346-0834-4872-a5bc-53910b21ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.297681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d346-0834-4872-a5bc-53910b21ce9d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.297963 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d346-0834-4872-a5bc-53910b21ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.298246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069d346-0834-4872-a5bc-53910b21ce9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.299004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d346-0834-4872-a5bc-53910b21ce9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.300611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069d346-0834-4872-a5bc-53910b21ce9d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.310810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1333/2679] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:19:35.315023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.325496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddd8b1-bf45-4fc3-ad0e-8766e002f90e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.330324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.331278 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.331502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.331806 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] PATH_INFO: `/v3/projects/4f0b4f72812f4c9f93c5dfb6d6ecc6ff/users/2881d9669c99482c8c71d00fc36788c0/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.346910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0b4f72812f4c9f93c5dfb6d6ecc6ff, user_id=2881d9669c99482c8c71d00fc36788c0, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.350191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.363810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1347/2680] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:35 2022] PUT /identity/v3/projects/4f0b4f72812f4c9f93c5dfb6d6ecc6ff/users/2881d9669c99482c8c71d00fc36788c0/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:35.373961 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cffa2-2fd5-4c34-88b5-9b481b5df0e7 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.374368 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cffa2-2fd5-4c34-88b5-9b481b5df0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.374656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cffa2-2fd5-4c34-88b5-9b481b5df0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.403057 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5d3cffa2-2fd5-4c34-88b5-9b481b5df0e7 None None] MFA Rules not processed for user `2881d9669c99482c8c71d00fc36788c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:35.404318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5d3cffa2-2fd5-4c34-88b5-9b481b5df0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:35.415136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:35.472412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1334/2681] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:35.477311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.524993 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d9ed-570c-4276-835c-8f641f8f5a83 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.525264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d9ed-570c-4276-835c-8f641f8f5a83 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.525577 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d9ed-570c-4276-835c-8f641f8f5a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.543381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2ed9d9ed-570c-4276-835c-8f641f8f5a83 None None] MFA Rules not processed for user `248adc39e0f84362b814deae09cdace0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:35.544640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2ed9d9ed-570c-4276-835c-8f641f8f5a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:35.556344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6d361-0745-47d7-a49f-d3f494c0a8ca admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.563189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.564232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.564705 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.565189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.566413 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.569637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.603856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1348/2682] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:35.604773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.610039 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:35.612674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1335/2683] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:19:35.671288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9e65a-9cd7-4a20-b1a1-0d3caa4e1046 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.676011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.676677 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.676975 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.677249 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.677931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.679886 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.701299 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1349/2684] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:19:35.705203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d9ed-570c-4276-835c-8f641f8f5a83 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.716908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d9ed-570c-4276-835c-8f641f8f5a83 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.721457 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.721758 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.722035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.722321 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.724916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.726533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.740194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1336/2685] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:35.741367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.752132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46970-3626-40e2-8774-a03112a5ec8b admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.757459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.758369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.758638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.758920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] PATH_INFO: `/v3/projects/524fb10cf9634655b4eed81d7bb2a194/users/0cfdee2bc391492998f5750dece4823f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.776003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] RBAC: Authorizing `identity:create_grant(project_id=524fb10cf9634655b4eed81d7bb2a194, user_id=0cfdee2bc391492998f5750dece4823f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.778664 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.791871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1350/2686] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:35 2022] PUT /identity/v3/projects/524fb10cf9634655b4eed81d7bb2a194/users/0cfdee2bc391492998f5750dece4823f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:35.796018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.806047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8794a-93b4-4a08-a4ee-3c81401fa752 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.867692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b59dc-588c-48f3-90dd-df4e762ea96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.868376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b59dc-588c-48f3-90dd-df4e762ea96b admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.868665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b59dc-588c-48f3-90dd-df4e762ea96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.868947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b59dc-588c-48f3-90dd-df4e762ea96b admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.869681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b59dc-588c-48f3-90dd-df4e762ea96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.871292 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b59dc-588c-48f3-90dd-df4e762ea96b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.882379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1337/2687] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:35.886881 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:35.900244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf81bbe-b649-4f92-a593-6ffdf066865f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:35.905371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:35.906329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.906680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.906958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] PATH_INFO: `/v3/projects/524fb10cf9634655b4eed81d7bb2a194/users/0cfdee2bc391492998f5750dece4823f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.908960 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=524fb10cf9634655b4eed81d7bb2a194, user_id=0cfdee2bc391492998f5750dece4823f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:35.911636 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:35.922554 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1351/2688] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:35 2022] PUT /identity/v3/projects/524fb10cf9634655b4eed81d7bb2a194/users/0cfdee2bc391492998f5750dece4823f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:35.933350 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb122-f909-4d06-b458-52f1f50d8f86 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:35.933671 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb122-f909-4d06-b458-52f1f50d8f86 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:35.933955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb122-f909-4d06-b458-52f1f50d8f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:35.961079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-498bb122-f909-4d06-b458-52f1f50d8f86 None None] MFA Rules not processed for user `0cfdee2bc391492998f5750dece4823f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:35.962308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-498bb122-f909-4d06-b458-52f1f50d8f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:35.992928 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:36.034580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1338/2689] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:36.045645 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:36.047381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:36.105087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c828b6-14e1-4fd6-be43-a68fbfa43ade admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:36.108847 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7dcd1-3bdb-4ade-aec0-531f7520e608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:36.109497 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7dcd1-3bdb-4ade-aec0-531f7520e608 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:36.109782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7dcd1-3bdb-4ade-aec0-531f7520e608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:36.110059 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7dcd1-3bdb-4ade-aec0-531f7520e608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:36.168335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7dcd1-3bdb-4ade-aec0-531f7520e608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:36.169723 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7dcd1-3bdb-4ade-aec0-531f7520e608 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:36.179631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1352/2690] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:38.731133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb122-f909-4d06-b458-52f1f50d8f86 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:38.816717 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bb122-f909-4d06-b458-52f1f50d8f86 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:38.821530 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:38.822509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:38.822858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:38.823236 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] PATH_INFO: `/v3/users/2881d9669c99482c8c71d00fc36788c0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:38.824627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2881d9669c99482c8c71d00fc36788c0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:38.827886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:38.879435 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2881d9669c99482c8c71d00fc36788c0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:38.880137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2881d9669c99482c8c71d00fc36788c0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:38.889060 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2881d9669c99482c8c71d00fc36788c0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:38.898286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2881d9669c99482c8c71d00fc36788c0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:38.898933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2881d9669c99482c8c71d00fc36788c0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:38.917907 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1339/2691] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:19:38 2022] DELETE /identity/v3/users/2881d9669c99482c8c71d00fc36788c0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:38.922346 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83025420-67df-4f35-b95c-b08033919e98 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:38.922846 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83025420-67df-4f35-b95c-b08033919e98 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:38.922948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83025420-67df-4f35-b95c-b08033919e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:38.940943 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-83025420-67df-4f35-b95c-b08033919e98 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:38.942199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-83025420-67df-4f35-b95c-b08033919e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:38.947897 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:39.006721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1353/2692] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:39.016661 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:39.018078 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:39.072148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:39.078998 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054145f4-9f11-41c7-9051-8e20b1347c70 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:39.084703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:39.085359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:39.085645 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:39.085921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:39.095385 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:39.096876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:39.107562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1340/2693] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:39.381742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83025420-67df-4f35-b95c-b08033919e98 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:39.383325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-83025420-67df-4f35-b95c-b08033919e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:39.396850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83025420-67df-4f35-b95c-b08033919e98 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:39.401817 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:39.402724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:39.403012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:39.403298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] PATH_INFO: `/v3/projects/4f0b4f72812f4c9f93c5dfb6d6ecc6ff` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:39.404521 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0b4f72812f4c9f93c5dfb6d6ecc6ff)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:39.406454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:39.453634 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0b4f72812f4c9f93c5dfb6d6ecc6ff', 'request_id': 'req-c4e8ed98-bc80-4971-a338-54975e2c5271'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.460437 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0b4f72812f4c9f93c5dfb6d6ecc6ff', 'request_id': 'req-c4e8ed98-bc80-4971-a338-54975e2c5271'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.466056 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0b4f72812f4c9f93c5dfb6d6ecc6ff', 'request_id': 'req-c4e8ed98-bc80-4971-a338-54975e2c5271'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.478523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] The token cache is being invalidate because project 4f0b4f72812f4c9f93c5dfb6d6ecc6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:19:39.478810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.479428 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.480993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1354/2694] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:19:39 2022] DELETE /identity/v3/projects/4f0b4f72812f4c9f93c5dfb6d6ecc6ff => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:39.485172 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:39.495028 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c969443-614b-4020-9f1f-93224244d92b service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:39.552569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:39.553447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:39.553733 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:39.554014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] PATH_INFO: `/v3/users/0cfdee2bc391492998f5750dece4823f` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:39.555196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfdee2bc391492998f5750dece4823f)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:39.557161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:39.602858 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfdee2bc391492998f5750dece4823f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.603506 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfdee2bc391492998f5750dece4823f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.610617 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfdee2bc391492998f5750dece4823f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.618189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfdee2bc391492998f5750dece4823f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.618994 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-b4cee7f9-b203-4940-9f7a-c46a7f3d8104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfdee2bc391492998f5750dece4823f'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:39.637924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1341/2695] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:19:39 2022] DELETE /identity/v3/users/0cfdee2bc391492998f5750dece4823f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:19:39.924617 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:39.927438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:39.940832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8ed98-bc80-4971-a338-54975e2c5271 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:39.997540 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:39.998330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:39.998631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:39.998882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] PATH_INFO: `/v3/projects/524fb10cf9634655b4eed81d7bb2a194` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.000105 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] RBAC: Authorizing `identity:delete_project(project_id=524fb10cf9634655b4eed81d7bb2a194)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.002017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.039543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:40.050320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524fb10cf9634655b4eed81d7bb2a194', 'request_id': 'req-a2185743-4d92-4334-ae0c-3947e09b360c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.056872 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524fb10cf9634655b4eed81d7bb2a194', 'request_id': 'req-a2185743-4d92-4334-ae0c-3947e09b360c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.062281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524fb10cf9634655b4eed81d7bb2a194', 'request_id': 'req-a2185743-4d92-4334-ae0c-3947e09b360c'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.074793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] The token cache is being invalidate because project 524fb10cf9634655b4eed81d7bb2a194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:19:40.075075 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.075725 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a2185743-4d92-4334-ae0c-3947e09b360c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.077257 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1355/2696] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:19:39 2022] DELETE /identity/v3/projects/524fb10cf9634655b4eed81d7bb2a194 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:40.082432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93db2-a819-47e4-afdd-2fc531cc3020 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.082913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93db2-a819-47e4-afdd-2fc531cc3020 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.083035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93db2-a819-47e4-afdd-2fc531cc3020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.101568 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-a9f93db2-a819-47e4-afdd-2fc531cc3020 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:40.102748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-a9f93db2-a819-47e4-afdd-2fc531cc3020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:40.162950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1342/2697] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:40.171922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a62f0-545e-49c8-ac9f-13ab5868e9af None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.172217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a62f0-545e-49c8-ac9f-13ab5868e9af None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.172498 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a62f0-545e-49c8-ac9f-13ab5868e9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.191224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-767a62f0-545e-49c8-ac9f-13ab5868e9af None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:40.192466 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-767a62f0-545e-49c8-ac9f-13ab5868e9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:40.200613 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1356/2698] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:40.204868 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f93db2-a819-47e4-afdd-2fc531cc3020 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.214741 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f93db2-a819-47e4-afdd-2fc531cc3020 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.219316 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.220012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.220330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.220607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.221337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:19:40.221648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.223801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.226190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:40.241341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1343/2699] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:19:40.242426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a62f0-545e-49c8-ac9f-13ab5868e9af None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.251683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a62f0-545e-49c8-ac9f-13ab5868e9af None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.256385 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.257038 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.257337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.257594 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.258277 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.260280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.286878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1357/2700] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:19:40 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:40.290658 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.300514 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac37f-64eb-4757-bc53-287426bcf683 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.356547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.357209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.357521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.357799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.358485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.360416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.381430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1344/2701] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:19:40 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:40.385603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.396208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c992fa6-ead1-44b2-b197-de19c9c7bafe admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.400810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.401471 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.401754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.402029 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.402751 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.404398 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.415192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1358/2702] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:40.419022 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.430258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9b1bc-2827-49c7-9282-95d5feb787fb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.434932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3c757-b503-4c2c-9234-56dc1bc42085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.435601 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3c757-b503-4c2c-9234-56dc1bc42085 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.435887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3c757-b503-4c2c-9234-56dc1bc42085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.436160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3c757-b503-4c2c-9234-56dc1bc42085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.436903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3c757-b503-4c2c-9234-56dc1bc42085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.438474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3c757-b503-4c2c-9234-56dc1bc42085 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.449189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1345/2703] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:19:40.453204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.463351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d1b3-0f78-41d4-8739-455c5809949a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.468027 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.468903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.469186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.469459 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] PATH_INFO: `/v3/projects/f22dfa31353143caae8dc155367ca804/users/120519a5a20c43059c27a05e21adf09a/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.484228 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22dfa31353143caae8dc155367ca804, user_id=120519a5a20c43059c27a05e21adf09a, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.486907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.500425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1359/2704] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:40 2022] PUT /identity/v3/projects/f22dfa31353143caae8dc155367ca804/users/120519a5a20c43059c27a05e21adf09a/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:40.510621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c094f2-d416-4418-a4ef-e071de74469f None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.510857 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c094f2-d416-4418-a4ef-e071de74469f None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.511162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c094f2-d416-4418-a4ef-e071de74469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.540349 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-84c094f2-d416-4418-a4ef-e071de74469f None None] MFA Rules not processed for user `120519a5a20c43059c27a05e21adf09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:40.541580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-84c094f2-d416-4418-a4ef-e071de74469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:40.608056 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1346/2705] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:40.619010 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.620783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:40.679351 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ddced-f5ee-4228-9825-6f63c1083dfd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.682973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6558e-a616-40cc-872f-593c6ef3c701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.683676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6558e-a616-40cc-872f-593c6ef3c701 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.683958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6558e-a616-40cc-872f-593c6ef3c701 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.684232 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6558e-a616-40cc-872f-593c6ef3c701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.693327 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6558e-a616-40cc-872f-593c6ef3c701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.694841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6558e-a616-40cc-872f-593c6ef3c701 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.703832 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1360/2706] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:40.728252 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c094f2-d416-4418-a4ef-e071de74469f None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.794264 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c094f2-d416-4418-a4ef-e071de74469f None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:40.798870 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:40.799771 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.800052 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.800348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] PATH_INFO: `/v3/users/120519a5a20c43059c27a05e21adf09a` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.801796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120519a5a20c43059c27a05e21adf09a)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:40.803827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:40.810143 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:40.854966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120519a5a20c43059c27a05e21adf09a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.855662 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120519a5a20c43059c27a05e21adf09a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.864323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120519a5a20c43059c27a05e21adf09a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.871511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120519a5a20c43059c27a05e21adf09a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.872184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120519a5a20c43059c27a05e21adf09a'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:40.889655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1347/2707] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:19:40 2022] DELETE /identity/v3/users/120519a5a20c43059c27a05e21adf09a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:40.894918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:40.895888 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:40.896251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:40.914099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:40.915292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:40.976908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1361/2708] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:40.986418 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:40.987863 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:41.044931 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7bc33-2956-413f-b3ad-15b934d01109 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.048544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8f9d3-5ff1-4a41-a5a9-6de119426999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.049185 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8f9d3-5ff1-4a41-a5a9-6de119426999 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.049471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8f9d3-5ff1-4a41-a5a9-6de119426999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.049748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8f9d3-5ff1-4a41-a5a9-6de119426999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.058935 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8f9d3-5ff1-4a41-a5a9-6de119426999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.060392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8f9d3-5ff1-4a41-a5a9-6de119426999 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.070622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1348/2709] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:41.406840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:41.408307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:41.416819 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:41.430703 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437543-60d8-49f2-b6d7-f864c4755290 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.444954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.445985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.446509 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.446957 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] PATH_INFO: `/v3/projects/f22dfa31353143caae8dc155367ca804` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.448455 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22dfa31353143caae8dc155367ca804)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.450606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.500809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22dfa31353143caae8dc155367ca804', 'request_id': 'req-9d6185bb-9f65-4183-ab43-9655b7da557b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:41.507945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22dfa31353143caae8dc155367ca804', 'request_id': 'req-9d6185bb-9f65-4183-ab43-9655b7da557b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:41.514287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22dfa31353143caae8dc155367ca804', 'request_id': 'req-9d6185bb-9f65-4183-ab43-9655b7da557b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:41.528226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] The token cache is being invalidate because project f22dfa31353143caae8dc155367ca804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:19:41.528518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:41.529152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-9d6185bb-9f65-4183-ab43-9655b7da557b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:41.530769 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1362/2710] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:19:41 2022] DELETE /identity/v3/projects/f22dfa31353143caae8dc155367ca804 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:41.535603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d6e3f-4390-418a-9999-dbc636abddc2 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.536086 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d6e3f-4390-418a-9999-dbc636abddc2 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.536213 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d6e3f-4390-418a-9999-dbc636abddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.556246 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-676d6e3f-4390-418a-9999-dbc636abddc2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:41.557493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-676d6e3f-4390-418a-9999-dbc636abddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:41.620517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1349/2711] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:41.628245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd93ef-b519-4110-981b-332ceaf3403b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.629124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd93ef-b519-4110-981b-332ceaf3403b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.629491 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd93ef-b519-4110-981b-332ceaf3403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.648877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-40dd93ef-b519-4110-981b-332ceaf3403b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:41.650126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-40dd93ef-b519-4110-981b-332ceaf3403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:41.658602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1363/2712] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:41.663444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d6e3f-4390-418a-9999-dbc636abddc2 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:41.673370 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d6e3f-4390-418a-9999-dbc636abddc2 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.678667 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.679309 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.679653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.679939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.680675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:19:41.680987 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.682580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.698722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1350/2713] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:19:41.699961 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd93ef-b519-4110-981b-332ceaf3403b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:41.710874 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd93ef-b519-4110-981b-332ceaf3403b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.715708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.716367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.716680 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.716980 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.717665 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.719632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.744928 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1364/2714] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:19:41 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:41.749102 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:41.759684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeed76-2649-4a36-b430-bbb68ee5c697 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.768654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:41.818593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.819279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.819569 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.819886 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.820591 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.822518 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.843393 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1351/2715] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:19:41 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:19:41.847197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:41.857448 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe470f68-60b4-4e15-a3b0-face43e6f2b8 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.862090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.862743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.863025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.863302 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.864085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.865668 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.876841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1365/2716] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:41.881268 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:41.891984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803d32-d345-4b05-9d71-2fb0e3987d48 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.897249 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73949a29-24db-4e29-8823-d540580c8e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.897909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73949a29-24db-4e29-8823-d540580c8e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.898196 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73949a29-24db-4e29-8823-d540580c8e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.898476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73949a29-24db-4e29-8823-d540580c8e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.899212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73949a29-24db-4e29-8823-d540580c8e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.900839 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73949a29-24db-4e29-8823-d540580c8e54 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.910770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1352/2717] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:41.915216 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:41.925335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336b416-0b9c-4357-aceb-b70c8ba92e11 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:41.930094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:41.930965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:41.931244 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:41.931518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] PATH_INFO: `/v3/projects/5e2343dcfb4645ac8055aac0f1c2b4fc/users/9171469a4c174e5bbd0534eb8fca64b7/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:41.946628 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2343dcfb4645ac8055aac0f1c2b4fc, user_id=9171469a4c174e5bbd0534eb8fca64b7, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:41.949831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:41.964050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1366/2718] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:41 2022] PUT /identity/v3/projects/5e2343dcfb4645ac8055aac0f1c2b4fc/users/9171469a4c174e5bbd0534eb8fca64b7/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:19:42.029885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb006a4-bfbc-47d5-8a5d-bf4cb811c0aa None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:42.030182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb006a4-bfbc-47d5-8a5d-bf4cb811c0aa None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:42.030466 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb006a4-bfbc-47d5-8a5d-bf4cb811c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:42.057653 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-bfb006a4-bfbc-47d5-8a5d-bf4cb811c0aa None None] MFA Rules not processed for user `9171469a4c174e5bbd0534eb8fca64b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:42.058866 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-bfb006a4-bfbc-47d5-8a5d-bf4cb811c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:42.125272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1353/2719] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:42.136504 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:42.138336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:42.196007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252d23d-c70e-4df7-bbbe-f5d53ada2555 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:42.199676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf23ef-90e3-4b07-8d08-9c3ab17faf30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:42.200315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf23ef-90e3-4b07-8d08-9c3ab17faf30 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:42.200596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf23ef-90e3-4b07-8d08-9c3ab17faf30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:42.200876 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf23ef-90e3-4b07-8d08-9c3ab17faf30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:42.209094 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf23ef-90e3-4b07-8d08-9c3ab17faf30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:42.210530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf23ef-90e3-4b07-8d08-9c3ab17faf30 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:42.219288 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1367/2720] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:51.940607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb006a4-bfbc-47d5-8a5d-bf4cb811c0aa None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:52.003395 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb006a4-bfbc-47d5-8a5d-bf4cb811c0aa None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:52.008054 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:52.008925 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.009210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.009487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] PATH_INFO: `/v3/users/9171469a4c174e5bbd0534eb8fca64b7` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.010681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9171469a4c174e5bbd0534eb8fca64b7)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:52.012647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:52.036522 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:52.061030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9171469a4c174e5bbd0534eb8fca64b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.061698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9171469a4c174e5bbd0534eb8fca64b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.068903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9171469a4c174e5bbd0534eb8fca64b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.075952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9171469a4c174e5bbd0534eb8fca64b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.076740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9171469a4c174e5bbd0534eb8fca64b7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.094766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1354/2721] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:19:51 2022] DELETE /identity/v3/users/9171469a4c174e5bbd0534eb8fca64b7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:52.100033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.100524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.100630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.117174 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:52.118369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:52.139069 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:52.180452 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1368/2722] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:52.190023 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:52.191977 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:52.250258 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175edca-67af-4b2f-ab96-0f46939b04fc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:52.254437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d619b-62f6-48a2-9ec5-f47108c85fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:52.255079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d619b-62f6-48a2-9ec5-f47108c85fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.255364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d619b-62f6-48a2-9ec5-f47108c85fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.255749 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d619b-62f6-48a2-9ec5-f47108c85fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.264991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d619b-62f6-48a2-9ec5-f47108c85fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:52.266688 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d619b-62f6-48a2-9ec5-f47108c85fa2 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:52.276937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1355/2723] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:19:52.549871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:52.552441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:52.572021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f4fdc-6293-4218-b4fb-464aa5b06b1b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:52.581016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:52.581931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.582246 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.582434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] PATH_INFO: `/v3/projects/5e2343dcfb4645ac8055aac0f1c2b4fc` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.583777 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2343dcfb4645ac8055aac0f1c2b4fc)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:52.585728 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:52.632241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2343dcfb4645ac8055aac0f1c2b4fc', 'request_id': 'req-f6b141d4-366f-4256-932a-b244c2b03d49'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.638311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2343dcfb4645ac8055aac0f1c2b4fc', 'request_id': 'req-f6b141d4-366f-4256-932a-b244c2b03d49'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.644514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2343dcfb4645ac8055aac0f1c2b4fc', 'request_id': 'req-f6b141d4-366f-4256-932a-b244c2b03d49'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.656502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] The token cache is being invalidate because project 5e2343dcfb4645ac8055aac0f1c2b4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:19:52.656793 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.657410 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f6b141d4-366f-4256-932a-b244c2b03d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:19:52.658966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1369/2724] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:19:52 2022] DELETE /identity/v3/projects/5e2343dcfb4645ac8055aac0f1c2b4fc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:52.663964 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817097a-bfe8-4556-8f0f-56f6120cc552 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.664256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817097a-bfe8-4556-8f0f-56f6120cc552 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.664533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817097a-bfe8-4556-8f0f-56f6120cc552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.683043 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-1817097a-bfe8-4556-8f0f-56f6120cc552 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:52.684299 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1817097a-bfe8-4556-8f0f-56f6120cc552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:52.745256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1356/2725] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:52.752979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d70d0-14a3-426d-a5da-769420e3c6e7 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.753279 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d70d0-14a3-426d-a5da-769420e3c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.753679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d70d0-14a3-426d-a5da-769420e3c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.772716 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-bb5d70d0-14a3-426d-a5da-769420e3c6e7 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:52.773919 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-bb5d70d0-14a3-426d-a5da-769420e3c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:52.781860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1370/2726] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:52.786215 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817097a-bfe8-4556-8f0f-56f6120cc552 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:52.796096 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817097a-bfe8-4556-8f0f-56f6120cc552 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:52.801181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:52.801831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.802115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.802399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.803129 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:19:52.803439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:52.805073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:52.817544 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1357/2727] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 10:19:52.821643 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d70d0-14a3-426d-a5da-769420e3c6e7 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:52.830945 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d70d0-14a3-426d-a5da-769420e3c6e7 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:52.836046 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:52.836698 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.836979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.837261 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.837956 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:52.839895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:52.869638 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1371/2728] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:19:52 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:52.873796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:52.884922 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1a18-b31b-4554-ba16-d1e1eb7b5654 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:52.918622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:52.948649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:52.949338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.949598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.949878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.950567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:52.952515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:52.971247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1358/2729] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:19:52 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:52.976028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:52.986489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f4b2-65a6-45a9-889d-69d1791daf17 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:52.992131 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:52.992813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:52.993100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:52.993406 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:52.994169 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:52.995993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:53.006652 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1372/2730] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:53.010729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:53.021055 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a08a-c054-4eb0-91ec-286b51f3a7f8 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:53.025840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c06d-dca5-40c7-98f5-fa78816b5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:53.026499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c06d-dca5-40c7-98f5-fa78816b5891 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:53.026785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c06d-dca5-40c7-98f5-fa78816b5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:53.027069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c06d-dca5-40c7-98f5-fa78816b5891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:53.027835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4c06d-dca5-40c7-98f5-fa78816b5891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:53.029434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4c06d-dca5-40c7-98f5-fa78816b5891 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:53.040432 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1359/2731] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:19:53.045076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:53.055727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67fcf-ad6f-40bd-8036-109fa6243660 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:53.060384 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:53.061252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:53.061537 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:53.061814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] PATH_INFO: `/v3/projects/47cc2cc2450248cfa699c39a06e65d29/users/c02f29f493084136a57da6cdfab519c0/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:53.077815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cc2cc2450248cfa699c39a06e65d29, user_id=c02f29f493084136a57da6cdfab519c0, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:53.080520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:53.094070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1373/2732] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:53 2022] PUT /identity/v3/projects/47cc2cc2450248cfa699c39a06e65d29/users/c02f29f493084136a57da6cdfab519c0/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:53.099923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d649fd-784e-4779-8efe-7b8ba0f9ebb3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:53.100214 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d649fd-784e-4779-8efe-7b8ba0f9ebb3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:53.100501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d649fd-784e-4779-8efe-7b8ba0f9ebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:53.118952 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-58d649fd-784e-4779-8efe-7b8ba0f9ebb3 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:53.120211 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-58d649fd-784e-4779-8efe-7b8ba0f9ebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:53.184826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1360/2733] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:53.194654 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:53.197057 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:53.260386 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:53.268280 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11247e75-9fa3-4b89-80d9-626be11b49de admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:53.273884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:53.274837 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:53.275307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:53.276546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:53.292238 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:53.293712 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:53.304165 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1374/2734] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:19:57.257811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6955cc2-eed1-4abe-9c80-48b785e7fc24 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:57.258318 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6955cc2-eed1-4abe-9c80-48b785e7fc24 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:57.258437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6955cc2-eed1-4abe-9c80-48b785e7fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:57.287336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-f6955cc2-eed1-4abe-9c80-48b785e7fc24 None None] MFA Rules not processed for user `c02f29f493084136a57da6cdfab519c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:19:57.288542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f6955cc2-eed1-4abe-9c80-48b785e7fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:19:57.369366 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1361/2735] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:19:57.373687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:57.386162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e342a3-b444-4943-a89b-f2d25c084a8f service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:57.391182 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:57.391896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:57.392184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:57.392460 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:57.393161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:57.395112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:57.428061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1375/2736] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:19:57 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:19:57.432110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6955cc2-eed1-4abe-9c80-48b785e7fc24 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:57.443721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6955cc2-eed1-4abe-9c80-48b785e7fc24 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:57.489585 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:19:57.509772 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:57.510467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:57.510756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:57.511037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:57.511777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:57.513708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:57.537618 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1362/2737] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:19:57 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:19:57.538957 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:57.550051 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484023-53fd-4110-8e4c-66024be84799 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:57.555598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:57.556297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:57.556588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:57.556871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:57.557625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:57.559231 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:57.573195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1376/2738] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:57.577462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:57.588279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb2bca-0372-4bae-af17-c53a9b24dc82 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:57.593144 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:57.594065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:57.594356 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:57.594639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] PATH_INFO: `/v3/projects/eac18627568b44c69d6c2c74ea954926/users/1ceb2243743e4690aff7d59a01c6b39f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:57.611195 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac18627568b44c69d6c2c74ea954926, user_id=1ceb2243743e4690aff7d59a01c6b39f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:57.614553 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:57.629864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1363/2739] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:57 2022] PUT /identity/v3/projects/eac18627568b44c69d6c2c74ea954926/users/1ceb2243743e4690aff7d59a01c6b39f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:19:57.633895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:57.644669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b735c1f-6a24-437f-8915-2aa576dccc01 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:57.706028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac0ae4-4861-4783-b79a-c8ee3f094093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:57.706739 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac0ae4-4861-4783-b79a-c8ee3f094093 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:57.707025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac0ae4-4861-4783-b79a-c8ee3f094093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:57.707306 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac0ae4-4861-4783-b79a-c8ee3f094093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:57.708130 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac0ae4-4861-4783-b79a-c8ee3f094093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:57.709789 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac0ae4-4861-4783-b79a-c8ee3f094093 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:57.720528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1377/2740] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:19:57.725034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:19:57.735687 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706f73a-601c-47e7-af85-769b7d2cbd46 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:19:57.741157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:19:57.742073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:19:57.742363 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:19:57.742642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] PATH_INFO: `/v3/projects/eac18627568b44c69d6c2c74ea954926/users/1ceb2243743e4690aff7d59a01c6b39f/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:19:57.744752 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac18627568b44c69d6c2c74ea954926, user_id=1ceb2243743e4690aff7d59a01c6b39f, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:19:57.747397 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:19:57.758960 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1364/2741] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:19:57 2022] PUT /identity/v3/projects/eac18627568b44c69d6c2c74ea954926/users/1ceb2243743e4690aff7d59a01c6b39f/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:20:02.002031 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8cc7-2b4b-4af2-b705-f16ef4f770fd None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:02.002541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8cc7-2b4b-4af2-b705-f16ef4f770fd None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:02.002719 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8cc7-2b4b-4af2-b705-f16ef4f770fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:02.030799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-78ef8cc7-2b4b-4af2-b705-f16ef4f770fd None None] MFA Rules not processed for user `1ceb2243743e4690aff7d59a01c6b39f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:20:02.032139 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-78ef8cc7-2b4b-4af2-b705-f16ef4f770fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:02.105030 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1378/2742] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:20:02.117505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:02.119229 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:02.182786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413bb56-6e49-481b-83b7-8d704472287b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:02.187014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:02.187698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:02.187978 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:02.188280 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:02.247396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:02.248879 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:02.258183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1365/2743] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:20:02.358369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cdfc-1601-4e14-b344-1fe6a6eb0b24 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:02.358663 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cdfc-1601-4e14-b344-1fe6a6eb0b24 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:02.358948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cdfc-1601-4e14-b344-1fe6a6eb0b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:02.377959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5e52cdfc-1601-4e14-b344-1fe6a6eb0b24 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:20:02.379915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5e52cdfc-1601-4e14-b344-1fe6a6eb0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:02.415480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:02.441882 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1379/2744] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:20:02.489938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:02.491339 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:02.548808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:02.573811 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d9b3b-efa0-42d3-aa66-e2d5ea8ce010 service glance] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:02.579416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:02.580189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:02.580473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:02.580748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:02.590433 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:02.592073 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:02.601089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1366/2745] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:20:11.286692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:11.287259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:11.287259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:11.304703 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] MFA Rules not processed for user `c02f29f493084136a57da6cdfab519c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:20:11.305908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:11.312821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1380/2746] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:20:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:20:11.351642 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:11.360989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a5c7-3168-48b7-aa66-5f351041313a service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:11.366739 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:11.367376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:11.367691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:11.367971 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:11.369701 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:11.450308 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:11.452674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:11.466019 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1367/2747] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:20:11.692949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:11.694400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:11.750618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97648e4-5655-4eeb-be8c-11d5499ee1fa None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:11.754183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:11.754896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:11.755116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:11.755394 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:11.757187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:11.766963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:11.768470 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:11.776519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1381/2748] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:20:12.097482 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:12.099237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:12.104688 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:12.114492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9bd9-3a4a-4c3d-a381-a7ceba6c3eea service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:12.118187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260e7a-fcbb-4840-91ee-3100150b8c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:12.118955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260e7a-fcbb-4840-91ee-3100150b8c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:12.119242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260e7a-fcbb-4840-91ee-3100150b8c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:12.119520 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260e7a-fcbb-4840-91ee-3100150b8c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:12.121332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6e260e7a-fcbb-4840-91ee-3100150b8c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:12.138028 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e260e7a-fcbb-4840-91ee-3100150b8c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:12.139480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e260e7a-fcbb-4840-91ee-3100150b8c85 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:12.154411 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1382/2749] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:20:12.175170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48de47b-6f77-4365-b38b-79c0e4f32258 service glance] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:12.180699 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:12.181354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:12.181639 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:12.181917 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:12.183760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:12.200340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:12.201995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:12.213422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1368/2750] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:20:13.450245 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc544b5-0dd2-492e-8dee-097ad0f91dd2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:13.450767 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc544b5-0dd2-492e-8dee-097ad0f91dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:13.450972 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc544b5-0dd2-492e-8dee-097ad0f91dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:13.470395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-afc544b5-0dd2-492e-8dee-097ad0f91dd2 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:20:13.471790 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-afc544b5-0dd2-492e-8dee-097ad0f91dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:13.479484 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1383/2751] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:20:13.493991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:13.506382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e3ad-b995-4468-8e1c-39b66de8c183 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:13.511622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966803-5762-4f26-9651-747966d1603e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:13.512293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966803-5762-4f26-9651-747966d1603e service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:13.512574 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966803-5762-4f26-9651-747966d1603e service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:13.512847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966803-5762-4f26-9651-747966d1603e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:13.523082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966803-5762-4f26-9651-747966d1603e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:13.524785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966803-5762-4f26-9651-747966d1603e service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:13.533853 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1369/2752] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:20:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:20:23.464727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=46 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:23.529991 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=83 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:25.105575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc544b5-0dd2-492e-8dee-097ad0f91dd2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:25.115291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc544b5-0dd2-492e-8dee-097ad0f91dd2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:25.118954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:25.119632 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:25.119923 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:25.120202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:25.121989 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:25.132126 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:25.133560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:25.141840 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1384/2753] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:20:25.748146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966803-5762-4f26-9651-747966d1603e service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:25.749786 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-86966803-5762-4f26-9651-747966d1603e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:25.780611 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966803-5762-4f26-9651-747966d1603e service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:25.787380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:25.788083 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:25.788367 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:25.788644 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:25.791004 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:25.805357 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:25.807844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:25.821307 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1370/2754] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:20:35.137924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=6 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:35.815477 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:39.309282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:39.318831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539b4c-c89f-47f8-ab34-b8bfae7db5b8 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:39.322579 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03858ea5-ce35-4f36-8597-dd9f0997daf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:39.323219 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858ea5-ce35-4f36-8597-dd9f0997daf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:39.323502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858ea5-ce35-4f36-8597-dd9f0997daf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:39.323811 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858ea5-ce35-4f36-8597-dd9f0997daf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:39.333371 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03858ea5-ce35-4f36-8597-dd9f0997daf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:39.334806 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03858ea5-ce35-4f36-8597-dd9f0997daf1 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:39.344285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1385/2755] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:20:42.980380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:20:42.984030 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:43.005255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ca73-35a4-4d06-a6bf-506785c87031 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:20:43.012423 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:20:43.015295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:20:43.015295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:20:43.015295 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:20:43.016921 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:20:43.032835 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:20:43.035287 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:20:43.048237 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1371/2756] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:20:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:20:49.340106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=6 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:20:53.043352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:21:15.841931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248fb5-7879-44f8-97ec-86c0d995334d None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:21:15.842477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248fb5-7879-44f8-97ec-86c0d995334d None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:21:15.842477 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248fb5-7879-44f8-97ec-86c0d995334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:21:15.859609 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d5248fb5-7879-44f8-97ec-86c0d995334d None None] MFA Rules not processed for user `248adc39e0f84362b814deae09cdace0`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:21:15.860798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d5248fb5-7879-44f8-97ec-86c0d995334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:21:15.918895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1386/2757] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:21:25.200746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:21:25.214602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b1bcd-6c23-4527-983a-5f330aa65ede service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:21:25.221705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:21:25.222411 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:21:25.222702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:21:25.222979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:21:25.224850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:21:25.238579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:21:25.240224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:21:25.251452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1372/2758] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:21:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:21:25.912200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=25 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:21:35.246709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=6 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:22:55.326220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a78d-7e72-4a5e-9952-d1883411935f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:22:55.326773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a78d-7e72-4a5e-9952-d1883411935f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:22:55.326887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a78d-7e72-4a5e-9952-d1883411935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:22:55.355133 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-1f45a78d-7e72-4a5e-9952-d1883411935f None None] MFA Rules not processed for user `248adc39e0f84362b814deae09cdace0`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:22:55.356450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-1f45a78d-7e72-4a5e-9952-d1883411935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:22:55.381557 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1387/2759] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:22:55.393705 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:22:55.460474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe982b-5a24-4ef4-aad4-6594575d30d2 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:22:55.466447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:22:55.467034 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:22:55.467320 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:22:55.467622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:22:55.469412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:22:55.479878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:22:55.481445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:22:55.490984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1373/2760] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:22:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:23:05.379441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=15 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:05.487002 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=30 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:05.796885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:05.797172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:05.797450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:05.865143 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:23:05.866379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:05.884070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1388/2761] 10.222.0.78 () {58 vars in 967 bytes} [Mon Jul 4 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:23:05.928546 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:05.953989 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b833f-9c52-42b1-a33d-b3160381c660 service nova] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:05.959145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:05.959837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:05.960125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:05.960459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:05.971536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:05.973189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:05.981485 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1374/2762] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:23:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:23:09.545011 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:09.547108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:09.563488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a0fad-4320-45fb-8335-2a08bb5ca2e5 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:09.568650 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:09.569258 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:09.569541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:09.569816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:09.571656 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:09.592735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:09.595053 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:09.606783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1389/2763] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:23:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:23:12.881640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:12.894286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cc7ff-bc99-4012-8721-b84bd368022e service swift] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:12.899336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:12.900021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:12.900301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:12.900572 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:12.902382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:12.915323 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:12.916937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:12.929207 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1375/2764] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:23:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:23:12.944083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:13.031348 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881745-5cdc-4424-952c-067d3b05c058 service placement] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:13.036414 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:13.037304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:13.037584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:13.037857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] PATH_INFO: `/v3/users/c02f29f493084136a57da6cdfab519c0` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:13.039080 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02f29f493084136a57da6cdfab519c0)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:13.041047 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:13.097457 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02f29f493084136a57da6cdfab519c0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.105580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02f29f493084136a57da6cdfab519c0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.106191 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02f29f493084136a57da6cdfab519c0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.106784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02f29f493084136a57da6cdfab519c0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.113925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02f29f493084136a57da6cdfab519c0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.128148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:13.133255 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1390/2765] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:23:12 2022] DELETE /identity/v3/users/c02f29f493084136a57da6cdfab519c0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:23:13.310382 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:13.323192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc824694-534c-4114-8dca-a05af35965d1 service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:13.387901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:13.389358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:13.389823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:13.390139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] PATH_INFO: `/v3/projects/47cc2cc2450248cfa699c39a06e65d29` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:13.391621 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cc2cc2450248cfa699c39a06e65d29)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:13.393521 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:13.440310 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cc2cc2450248cfa699c39a06e65d29', 'request_id': 'req-929922bb-af07-44c6-979a-90f74c8aedef'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.447451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cc2cc2450248cfa699c39a06e65d29', 'request_id': 'req-929922bb-af07-44c6-979a-90f74c8aedef'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.453186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cc2cc2450248cfa699c39a06e65d29', 'request_id': 'req-929922bb-af07-44c6-979a-90f74c8aedef'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.476383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] The token cache is being invalidate because project 47cc2cc2450248cfa699c39a06e65d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:23:13.476678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.477358 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.478941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1376/2766] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:23:13 2022] DELETE /identity/v3/projects/47cc2cc2450248cfa699c39a06e65d29 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:23:13.482889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:13.484816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:13.497792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325e67-1996-4e26-a4a9-b3b9a072e431 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:13.552910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:13.553826 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:13.554061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:13.554337 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] PATH_INFO: `/v3/users/1ceb2243743e4690aff7d59a01c6b39f` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:13.555536 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ceb2243743e4690aff7d59a01c6b39f)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:13.557756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:13.605710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ceb2243743e4690aff7d59a01c6b39f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.613479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ceb2243743e4690aff7d59a01c6b39f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.614119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ceb2243743e4690aff7d59a01c6b39f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.614741 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ceb2243743e4690aff7d59a01c6b39f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.621655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ceb2243743e4690aff7d59a01c6b39f'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.639799 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1391/2767] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:23:13 2022] DELETE /identity/v3/users/1ceb2243743e4690aff7d59a01c6b39f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:23:13.826365 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:13.833502 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:13.848225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929922bb-af07-44c6-979a-90f74c8aedef admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:13.901698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:13.922183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:13.923158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:13.923515 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:13.923891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] PATH_INFO: `/v3/projects/eac18627568b44c69d6c2c74ea954926` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:13.925157 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac18627568b44c69d6c2c74ea954926)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:13.927298 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:13.977353 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac18627568b44c69d6c2c74ea954926', 'request_id': 'req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.985735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac18627568b44c69d6c2c74ea954926', 'request_id': 'req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:13.991633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac18627568b44c69d6c2c74ea954926', 'request_id': 'req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:14.002909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] The token cache is being invalidate because project eac18627568b44c69d6c2c74ea954926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:23:14.003203 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:14.003941 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:23:14.005511 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1377/2768] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:23:13 2022] DELETE /identity/v3/projects/eac18627568b44c69d6c2c74ea954926 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:23:23.635959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:24.000510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:23:34.538315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:23:34.539785 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:34.631949 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150ee1-7a48-446a-9999-725226a0812d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:23:34.690865 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:23:34.691511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:23:34.691835 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:23:34.692108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:23:34.693905 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:23:34.705601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:23:34.707170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:23:34.716947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1392/2769] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:23:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:23:44.712850 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=67 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:45.007735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:45.009404 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:45.088538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e3231-b61b-46c8-9dd1-c63d83b21ae7 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:45.092290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:45.092933 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:45.093218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:45.093493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:45.095256 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:45.157860 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:45.159225 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:45.168833 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1378/2770] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:48.072679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.078787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:48.097325 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb0127-231e-47e9-88b3-adfa9dcab2b8 service placement] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.104171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.106764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.107123 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.107947 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] PATH_INFO: `/v3/users/248adc39e0f84362b814deae09cdace0` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.109173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] RBAC: Authorizing `identity:delete_user(user_id=248adc39e0f84362b814deae09cdace0)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.111100 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.160017 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248adc39e0f84362b814deae09cdace0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.167349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248adc39e0f84362b814deae09cdace0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.168036 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248adc39e0f84362b814deae09cdace0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.168669 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248adc39e0f84362b814deae09cdace0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.178527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-986124db-20ca-4773-916e-069dc53c063d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248adc39e0f84362b814deae09cdace0'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.195994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1393/2771] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:24:48 2022] DELETE /identity/v3/users/248adc39e0f84362b814deae09cdace0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:48.365257 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.375175 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d74c-b1bd-42a7-a9fd-bea63b9409e0 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.434656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.435548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.435872 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.436150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] PATH_INFO: `/v3/projects/4830264311074d689358e7b036f578ae` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.437338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4830264311074d689358e7b036f578ae)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.439251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.473378 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:48.486773 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4830264311074d689358e7b036f578ae', 'request_id': 'req-0024fdf3-f1d5-494e-9114-b38dc16c73fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.494698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4830264311074d689358e7b036f578ae', 'request_id': 'req-0024fdf3-f1d5-494e-9114-b38dc16c73fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.500348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4830264311074d689358e7b036f578ae', 'request_id': 'req-0024fdf3-f1d5-494e-9114-b38dc16c73fb'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.511270 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] The token cache is being invalidate because project 4830264311074d689358e7b036f578ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:24:48.511558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.512212 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-0024fdf3-f1d5-494e-9114-b38dc16c73fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:48.514372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1379/2772] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:24:48 2022] DELETE /identity/v3/projects/4830264311074d689358e7b036f578ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:48.519203 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f4a9b-fb26-4bae-a9d4-650cf3503ca8 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.519523 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f4a9b-fb26-4bae-a9d4-650cf3503ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.519860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f4a9b-fb26-4bae-a9d4-650cf3503ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.577378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-6a8f4a9b-fb26-4bae-a9d4-650cf3503ca8 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:48.578517 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6a8f4a9b-fb26-4bae-a9d4-650cf3503ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:48.635915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1394/2773] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:24:48.644377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f7fcb-5765-47cf-8714-9e00847ccd93 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.644665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f7fcb-5765-47cf-8714-9e00847ccd93 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.644938 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f7fcb-5765-47cf-8714-9e00847ccd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.664557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-2d5f7fcb-5765-47cf-8714-9e00847ccd93 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:48.665760 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-2d5f7fcb-5765-47cf-8714-9e00847ccd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:48.673607 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1380/2774] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:48.677745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f4a9b-fb26-4bae-a9d4-650cf3503ca8 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.687433 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f4a9b-fb26-4bae-a9d4-650cf3503ca8 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.692096 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.692748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.693035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.693316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.694050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:24:48.694362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.696008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.708171 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1395/2775] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:24:48.712471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f7fcb-5765-47cf-8714-9e00847ccd93 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.722344 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f7fcb-5765-47cf-8714-9e00847ccd93 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.726959 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.727630 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.727914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.728189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.728873 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.730736 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.756041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1381/2776] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:48 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:48.760376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.770813 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6de153-c67e-461f-889d-816bd4944232 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.797995 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:48.830588 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.831190 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.831503 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.831808 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.832505 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.834584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.854766 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1396/2777] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:48 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:48.859158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.869622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7b5f4-2792-4098-9c08-112c7d0ed808 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.874926 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.875598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.875901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.876180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.876908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.878495 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.889776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1382/2778] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:48.893670 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.903444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec759c20-800b-4dc4-aee7-c6456e9d63d7 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.908081 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f23735-d59c-46bf-9d21-a2e72adedf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.908727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23735-d59c-46bf-9d21-a2e72adedf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.909007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23735-d59c-46bf-9d21-a2e72adedf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.909281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23735-d59c-46bf-9d21-a2e72adedf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.909996 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f23735-d59c-46bf-9d21-a2e72adedf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.911598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f23735-d59c-46bf-9d21-a2e72adedf9b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.923183 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1397/2779] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:48.927193 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:48.937634 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2be32-0e93-4cd4-bb95-c158907f065f admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:48.942197 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:48.943069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.943352 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.943665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] PATH_INFO: `/v3/projects/d0a2ebee99ee4554a7ee98660d481958/users/d5aed3a2e9e747b0ab508adf9659ffff/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:48.959239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a2ebee99ee4554a7ee98660d481958, user_id=d5aed3a2e9e747b0ab508adf9659ffff, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:48.961927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:48.974743 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1383/2780] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:48 2022] PUT /identity/v3/projects/d0a2ebee99ee4554a7ee98660d481958/users/d5aed3a2e9e747b0ab508adf9659ffff/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:48.985724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c4a4-3f0e-4f07-adf7-85e56f0d9b31 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:48.986013 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c4a4-3f0e-4f07-adf7-85e56f0d9b31 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:48.986287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c4a4-3f0e-4f07-adf7-85e56f0d9b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.012702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e423c4a4-3f0e-4f07-adf7-85e56f0d9b31 None None] MFA Rules not processed for user `d5aed3a2e9e747b0ab508adf9659ffff`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:49.014528 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e423c4a4-3f0e-4f07-adf7-85e56f0d9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:49.080285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1398/2781] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:49.084800 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.148782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2f771-a944-4aa3-bfe2-f55141125ad9 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.153566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.154276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.154566 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.154848 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.155603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.157509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.183326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1384/2782] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:49 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:24:49.187906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423c4a4-3f0e-4f07-adf7-85e56f0d9b31 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.198513 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423c4a4-3f0e-4f07-adf7-85e56f0d9b31 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.256667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.257350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.257630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.257951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.258920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.260860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.281550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1399/2783] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:49 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:49.285523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.296444 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989d91e-6978-4e74-92e9-cb3dda2acf85 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.301046 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.301707 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.302066 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.302260 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.302986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.304619 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.315691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1385/2784] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:49.319916 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.329849 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f782-7325-405a-babd-8956d07144d5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.334568 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.335524 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.335782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.336064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] PATH_INFO: `/v3/projects/bd830b65a6044ad69cad67aa884c3ee3/users/4a1fde48637e4e1abd1791054faecab6/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.350421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd830b65a6044ad69cad67aa884c3ee3, user_id=4a1fde48637e4e1abd1791054faecab6, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.353620 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.367061 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1400/2785] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:49 2022] PUT /identity/v3/projects/bd830b65a6044ad69cad67aa884c3ee3/users/4a1fde48637e4e1abd1791054faecab6/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:49.371071 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.382182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8825-88a9-45f9-9935-f6ad6ef90161 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.411020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:49.441173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0ed76-121b-4064-b95f-5037d1b37fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.441861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0ed76-121b-4064-b95f-5037d1b37fad admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.442166 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0ed76-121b-4064-b95f-5037d1b37fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.442420 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0ed76-121b-4064-b95f-5037d1b37fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.443141 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0ed76-121b-4064-b95f-5037d1b37fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.444751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0ed76-121b-4064-b95f-5037d1b37fad admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.454817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1386/2786] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:49.459070 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.464724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:49.471180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258c672-a16a-4919-bdc3-3feadf916b9e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.476124 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.476999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.477282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.477556 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] PATH_INFO: `/v3/projects/bd830b65a6044ad69cad67aa884c3ee3/users/4a1fde48637e4e1abd1791054faecab6/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.479508 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd830b65a6044ad69cad67aa884c3ee3, user_id=4a1fde48637e4e1abd1791054faecab6, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.482187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.492918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1401/2787] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:49 2022] PUT /identity/v3/projects/bd830b65a6044ad69cad67aa884c3ee3/users/4a1fde48637e4e1abd1791054faecab6/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:49.503388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d115d-c796-4155-937c-0db30f6d2545 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.503725 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d115d-c796-4155-937c-0db30f6d2545 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.504014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d115d-c796-4155-937c-0db30f6d2545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.530072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-080d115d-c796-4155-937c-0db30f6d2545 None None] MFA Rules not processed for user `4a1fde48637e4e1abd1791054faecab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:49.531290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-080d115d-c796-4155-937c-0db30f6d2545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:49.601536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1387/2788] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:49.612526 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.614259 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:49.671742 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f18c9-ce73-4a64-aa90-553eedf01a91 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.675335 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74340f05-7f99-4ba4-9065-c5d1020b3e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.676012 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74340f05-7f99-4ba4-9065-c5d1020b3e59 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.676295 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74340f05-7f99-4ba4-9065-c5d1020b3e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.676797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74340f05-7f99-4ba4-9065-c5d1020b3e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.687099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74340f05-7f99-4ba4-9065-c5d1020b3e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.688541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74340f05-7f99-4ba4-9065-c5d1020b3e59 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.697922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1402/2789] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:49.836279 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d115d-c796-4155-937c-0db30f6d2545 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:49.899747 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d115d-c796-4155-937c-0db30f6d2545 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:49.904843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:49.905731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.906015 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.906290 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] PATH_INFO: `/v3/users/d5aed3a2e9e747b0ab508adf9659ffff` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:49.907500 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5aed3a2e9e747b0ab508adf9659ffff)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:49.909450 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:49.954170 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5aed3a2e9e747b0ab508adf9659ffff'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:49.954812 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5aed3a2e9e747b0ab508adf9659ffff'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:49.962222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5aed3a2e9e747b0ab508adf9659ffff'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:49.963456 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:49.972301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5aed3a2e9e747b0ab508adf9659ffff'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:49.973017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5aed3a2e9e747b0ab508adf9659ffff'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:49.990338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1388/2790] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:24:49 2022] DELETE /identity/v3/users/d5aed3a2e9e747b0ab508adf9659ffff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:49.994798 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:49.995083 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:49.995358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:50.013286 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:50.014815 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:50.072571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1403/2791] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:50.082664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:50.084098 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:50.141691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b591b-c755-4d57-9958-db3f4aabe85c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:50.145407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:50.146050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:50.146332 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:50.146610 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:50.156272 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:50.157633 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:50.166968 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1389/2792] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:50.431920 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:50.433369 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:50.453403 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66c4a9-65a1-4ca3-a27a-c2a0c2e7a640 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:50.458235 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:50.459332 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:50.459756 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:50.460157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] PATH_INFO: `/v3/projects/d0a2ebee99ee4554a7ee98660d481958` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:50.461755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a2ebee99ee4554a7ee98660d481958)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:50.463794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:50.510242 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a2ebee99ee4554a7ee98660d481958', 'request_id': 'req-e58f6530-870d-43d6-96b6-a64001dac092'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.517243 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a2ebee99ee4554a7ee98660d481958', 'request_id': 'req-e58f6530-870d-43d6-96b6-a64001dac092'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.523033 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a2ebee99ee4554a7ee98660d481958', 'request_id': 'req-e58f6530-870d-43d6-96b6-a64001dac092'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.535773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] The token cache is being invalidate because project d0a2ebee99ee4554a7ee98660d481958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:24:50.536064 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.536689 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.538215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1404/2793] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:24:50 2022] DELETE /identity/v3/projects/d0a2ebee99ee4554a7ee98660d481958 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:50.542192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:50.552044 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f67d-87c0-43cf-a8fb-55295bfaec0c service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:50.609847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:50.610722 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:50.611001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:50.611275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] PATH_INFO: `/v3/users/4a1fde48637e4e1abd1791054faecab6` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:50.612493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1fde48637e4e1abd1791054faecab6)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:50.614403 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:50.659992 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1fde48637e4e1abd1791054faecab6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.660654 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1fde48637e4e1abd1791054faecab6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.667826 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1fde48637e4e1abd1791054faecab6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.674844 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1fde48637e4e1abd1791054faecab6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.675422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-e5dda003-368e-4334-80e0-1340935e314c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1fde48637e4e1abd1791054faecab6'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:50.686001 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:50.695459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1390/2794] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:24:50 2022] DELETE /identity/v3/users/4a1fde48637e4e1abd1791054faecab6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:50.972637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:50.974168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:50.991595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f6530-870d-43d6-96b6-a64001dac092 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.004606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:51.052667 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.053560 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.053829 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.054109 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] PATH_INFO: `/v3/projects/bd830b65a6044ad69cad67aa884c3ee3` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.055309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd830b65a6044ad69cad67aa884c3ee3)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.058205 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.103618 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd830b65a6044ad69cad67aa884c3ee3', 'request_id': 'req-d4ba8483-8ecb-4060-883e-bf044d8f9a36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:51.110272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd830b65a6044ad69cad67aa884c3ee3', 'request_id': 'req-d4ba8483-8ecb-4060-883e-bf044d8f9a36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:51.115902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd830b65a6044ad69cad67aa884c3ee3', 'request_id': 'req-d4ba8483-8ecb-4060-883e-bf044d8f9a36'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:51.128895 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] The token cache is being invalidate because project bd830b65a6044ad69cad67aa884c3ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:24:51.129186 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:51.129807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d4ba8483-8ecb-4060-883e-bf044d8f9a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:51.131343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1405/2795] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:24:50 2022] DELETE /identity/v3/projects/bd830b65a6044ad69cad67aa884c3ee3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:51.136757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9542-cd1f-4bbc-b868-048bf3c33711 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.137050 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9542-cd1f-4bbc-b868-048bf3c33711 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.137334 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9542-cd1f-4bbc-b868-048bf3c33711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.156348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-3a9b9542-cd1f-4bbc-b868-048bf3c33711 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:51.157567 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-3a9b9542-cd1f-4bbc-b868-048bf3c33711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:51.216441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1391/2796] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:51.224854 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669180c-3518-4e45-ab33-e7b6cd7c76ed None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.225146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669180c-3518-4e45-ab33-e7b6cd7c76ed None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.225426 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669180c-3518-4e45-ab33-e7b6cd7c76ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.244435 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-6669180c-3518-4e45-ab33-e7b6cd7c76ed None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:51.245676 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-6669180c-3518-4e45-ab33-e7b6cd7c76ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:51.253695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1406/2797] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:51.257913 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9542-cd1f-4bbc-b868-048bf3c33711 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.268118 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9542-cd1f-4bbc-b868-048bf3c33711 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.272715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.273373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.273659 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.273932 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.274665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:24:51.274974 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.276594 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.288632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1392/2798] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:24:51.292666 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669180c-3518-4e45-ab33-e7b6cd7c76ed None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.302637 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669180c-3518-4e45-ab33-e7b6cd7c76ed None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.307407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.308202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.308490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.308770 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.309472 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.311377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.336297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1407/2799] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:51 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:24:51.340383 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.350969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8a5c-b1f0-419b-8b10-1fde84cf1884 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.408519 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.409206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.409487 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.409767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.410468 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.412406 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.435430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1393/2800] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:51 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:24:51.440487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.451379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf77b3-5d6d-4f9b-b914-aaa8c656045a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.456014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.456674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.456955 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.457230 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.457954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.459541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.471446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1408/2801] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:51.475275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.485767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d56b53-653c-4339-aaf7-b43b2dd7346d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.490354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b29c9-4e50-4ee8-8ae1-d5094bc30766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.491006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b29c9-4e50-4ee8-8ae1-d5094bc30766 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.491289 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b29c9-4e50-4ee8-8ae1-d5094bc30766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.491565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b29c9-4e50-4ee8-8ae1-d5094bc30766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.492311 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b29c9-4e50-4ee8-8ae1-d5094bc30766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.493887 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b29c9-4e50-4ee8-8ae1-d5094bc30766 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.503842 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1394/2802] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:24:51.507915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.518706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa30dec-60d0-4d95-8d51-c502211ef9d6 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.523458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.524400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.524707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.524985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] PATH_INFO: `/v3/projects/ea64d28012704f41a8f126527ad02de0/users/a07d6a4e52864e14bf38777ed3f43e70/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.540170 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64d28012704f41a8f126527ad02de0, user_id=a07d6a4e52864e14bf38777ed3f43e70, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.542828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.555694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1409/2803] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:51 2022] PUT /identity/v3/projects/ea64d28012704f41a8f126527ad02de0/users/a07d6a4e52864e14bf38777ed3f43e70/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:51.567136 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260a1b-aecc-4f89-b122-2896acb012f3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.567690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260a1b-aecc-4f89-b122-2896acb012f3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.567809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260a1b-aecc-4f89-b122-2896acb012f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.596809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-88260a1b-aecc-4f89-b122-2896acb012f3 None None] MFA Rules not processed for user `a07d6a4e52864e14bf38777ed3f43e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:51.598684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-88260a1b-aecc-4f89-b122-2896acb012f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:51.648082 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:51.667776 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1395/2804] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:51.672441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.717234 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:51.735422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdfb11-c4de-412e-81db-947d28a0a740 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.740136 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.740792 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.741076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.741378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.742065 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.744007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.773925 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1410/2805] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:51 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:51.783651 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260a1b-aecc-4f89-b122-2896acb012f3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.797806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260a1b-aecc-4f89-b122-2896acb012f3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.854230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.854908 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.855194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.855473 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.856200 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.858158 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.878224 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1396/2806] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:51 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:51.881993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.893195 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb9f2a-f39d-40c9-b7b9-647560415f0a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.898213 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.898869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.899152 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.899427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.900197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.901783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.912287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1411/2807] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:51.916369 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.926438 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44982910-36c1-4162-b4cd-230f6e7030be admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:51.930980 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:51.931897 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:51.932180 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:51.932459 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] PATH_INFO: `/v3/projects/6e87090689ab46ae8f0e55d7c3846162/users/ee7f9f85c2df49f7912cb37351766a0e/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:51.948751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e87090689ab46ae8f0e55d7c3846162, user_id=ee7f9f85c2df49f7912cb37351766a0e, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:51.951995 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:51.964597 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1397/2808] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:51 2022] PUT /identity/v3/projects/6e87090689ab46ae8f0e55d7c3846162/users/ee7f9f85c2df49f7912cb37351766a0e/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:51.968307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:51.978922 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f48c-a638-4070-b43a-2db2cf8c6e04 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:52.035875 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635e70b-4337-4730-88bb-ca7d56278440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:52.036463 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635e70b-4337-4730-88bb-ca7d56278440 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:52.036743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635e70b-4337-4730-88bb-ca7d56278440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:52.037020 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635e70b-4337-4730-88bb-ca7d56278440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:52.037749 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635e70b-4337-4730-88bb-ca7d56278440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:52.039370 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635e70b-4337-4730-88bb-ca7d56278440 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:52.049454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1412/2809] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:52.053975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:52.064794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376089-b09c-429f-9423-8e8f05351670 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:52.070510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:52.071796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:52.071796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:52.071796 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] PATH_INFO: `/v3/projects/6e87090689ab46ae8f0e55d7c3846162/users/ee7f9f85c2df49f7912cb37351766a0e/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:52.074217 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e87090689ab46ae8f0e55d7c3846162, user_id=ee7f9f85c2df49f7912cb37351766a0e, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:52.077972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:52.097547 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1398/2810] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:52 2022] PUT /identity/v3/projects/6e87090689ab46ae8f0e55d7c3846162/users/ee7f9f85c2df49f7912cb37351766a0e/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:52.107722 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02d865-1a5d-424f-8598-5ea7cc85cb2b None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:52.108019 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02d865-1a5d-424f-8598-5ea7cc85cb2b None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:52.108297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02d865-1a5d-424f-8598-5ea7cc85cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:52.134857 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-ee02d865-1a5d-424f-8598-5ea7cc85cb2b None None] MFA Rules not processed for user `ee7f9f85c2df49f7912cb37351766a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:52.136107 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-ee02d865-1a5d-424f-8598-5ea7cc85cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:52.204787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1413/2811] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:52.216181 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:52.217923 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:52.274510 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8060-510c-4ed3-990b-811bf230840c admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:52.278113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6686f6-7bf6-4453-99de-d35baca52100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:52.278754 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6686f6-7bf6-4453-99de-d35baca52100 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:52.279048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6686f6-7bf6-4453-99de-d35baca52100 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:52.279331 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6686f6-7bf6-4453-99de-d35baca52100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:52.288324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6686f6-7bf6-4453-99de-d35baca52100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:52.289681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6686f6-7bf6-4453-99de-d35baca52100 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:52.299452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1399/2812] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:53.601489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02d865-1a5d-424f-8598-5ea7cc85cb2b None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:53.642775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:53.664703 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02d865-1a5d-424f-8598-5ea7cc85cb2b None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:53.669265 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:53.670134 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:53.670416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:53.670694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] PATH_INFO: `/v3/users/a07d6a4e52864e14bf38777ed3f43e70` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:53.671915 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07d6a4e52864e14bf38777ed3f43e70)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:53.674333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:53.718270 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07d6a4e52864e14bf38777ed3f43e70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:53.724727 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07d6a4e52864e14bf38777ed3f43e70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:53.725354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07d6a4e52864e14bf38777ed3f43e70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:53.725954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07d6a4e52864e14bf38777ed3f43e70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:53.733269 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07d6a4e52864e14bf38777ed3f43e70'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:53.751622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1414/2813] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:24:53 2022] DELETE /identity/v3/users/a07d6a4e52864e14bf38777ed3f43e70 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:53.756167 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:53.756664 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:53.756823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:53.774550 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:53.775785 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:53.816227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:53.837222 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1400/2814] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:53.846867 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:53.848328 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:53.905707 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d197d2-4a60-4c03-b0c9-c1d06f7f6658 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:53.909580 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:53.910233 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:53.910518 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:53.911603 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:53.921511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:53.923479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:53.932913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1415/2815] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:54.208215 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:54.209681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:54.222768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ec3b9-4a20-41fb-bcbd-c16ba919fb47 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:54.227426 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:54.228326 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:54.228605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:54.228878 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] PATH_INFO: `/v3/projects/ea64d28012704f41a8f126527ad02de0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:54.230074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea64d28012704f41a8f126527ad02de0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:54.232017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:54.278374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea64d28012704f41a8f126527ad02de0', 'request_id': 'req-5cae7016-30ed-4190-a03c-aec5b23b7720'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.286200 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea64d28012704f41a8f126527ad02de0', 'request_id': 'req-5cae7016-30ed-4190-a03c-aec5b23b7720'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.292247 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea64d28012704f41a8f126527ad02de0', 'request_id': 'req-5cae7016-30ed-4190-a03c-aec5b23b7720'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.303885 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] The token cache is being invalidate because project ea64d28012704f41a8f126527ad02de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:24:54.304173 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.304801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.306343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1401/2816] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:24:54 2022] DELETE /identity/v3/projects/ea64d28012704f41a8f126527ad02de0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:54.310297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:54.320089 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89da3-837b-484d-8d12-1a6b3165b3c3 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:54.376282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:54.377202 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:54.377434 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:54.377710 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] PATH_INFO: `/v3/users/ee7f9f85c2df49f7912cb37351766a0e` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:54.378918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7f9f85c2df49f7912cb37351766a0e)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:54.380889 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:54.382359 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:54.431748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7f9f85c2df49f7912cb37351766a0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.439042 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7f9f85c2df49f7912cb37351766a0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.439692 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7f9f85c2df49f7912cb37351766a0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.440320 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7f9f85c2df49f7912cb37351766a0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.447541 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-2da9ddc3-0cf0-4748-8ba4-c5474e4b965f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7f9f85c2df49f7912cb37351766a0e'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.465218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1416/2817] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:24:54 2022] DELETE /identity/v3/users/ee7f9f85c2df49f7912cb37351766a0e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:54.739528 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:54.741024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:54.755491 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae7016-30ed-4190-a03c-aec5b23b7720 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:54.814538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:54.815407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:54.815738 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:54.816017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] PATH_INFO: `/v3/projects/6e87090689ab46ae8f0e55d7c3846162` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:54.817210 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e87090689ab46ae8f0e55d7c3846162)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:54.819115 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:54.865209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e87090689ab46ae8f0e55d7c3846162', 'request_id': 'req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.873761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e87090689ab46ae8f0e55d7c3846162', 'request_id': 'req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.880012 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e87090689ab46ae8f0e55d7c3846162', 'request_id': 'req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.887386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:54.893380 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] The token cache is being invalidate because project 6e87090689ab46ae8f0e55d7c3846162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:24:54.893713 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.894483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-cc2cc160-274c-4e2f-bdca-2c2f30034f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:54.896770 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1402/2818] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:24:54 2022] DELETE /identity/v3/projects/6e87090689ab46ae8f0e55d7c3846162 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:54.901610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7e0b-e211-4cb1-b1ab-8e0a598658f0 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:54.902102 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7e0b-e211-4cb1-b1ab-8e0a598658f0 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:54.902220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7e0b-e211-4cb1-b1ab-8e0a598658f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:54.922918 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-66ca7e0b-e211-4cb1-b1ab-8e0a598658f0 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:54.924180 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-66ca7e0b-e211-4cb1-b1ab-8e0a598658f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:54.984561 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1417/2819] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:54.993194 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137460-9056-41ea-acad-253a4698f436 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:54.993492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137460-9056-41ea-acad-253a4698f436 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:54.993777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137460-9056-41ea-acad-253a4698f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.012827 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-da137460-9056-41ea-acad-253a4698f436 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:55.014047 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-da137460-9056-41ea-acad-253a4698f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:55.022807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1403/2820] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:55.026896 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca7e0b-e211-4cb1-b1ab-8e0a598658f0 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.036623 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca7e0b-e211-4cb1-b1ab-8e0a598658f0 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.041458 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.042117 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.042400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.042675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.043405 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:24:55.043750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.045374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.056825 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1418/2821] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:24:55.060902 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137460-9056-41ea-acad-253a4698f436 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.070793 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137460-9056-41ea-acad-253a4698f436 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.075504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.076191 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.076478 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.076756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.077437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.080009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.105219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1404/2822] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:55.109456 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.119354 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc5e9a-880f-404b-9ceb-07d8463a1e7a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.175823 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.176422 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.176695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.176971 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.177653 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.179562 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.189545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:55.202118 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1419/2823] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:55 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:55.206113 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.216721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f49b7-da89-4312-bc4d-13506a242d17 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.221431 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.222099 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.222387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.222669 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.223400 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.225038 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.236162 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1405/2824] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:55.240185 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.250114 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57737cf-850d-4c7f-8f78-520f49b76365 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.255492 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca448d04-ea6b-4a9e-8134-0d3eebbd1b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.256187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448d04-ea6b-4a9e-8134-0d3eebbd1b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.256479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448d04-ea6b-4a9e-8134-0d3eebbd1b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.256759 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448d04-ea6b-4a9e-8134-0d3eebbd1b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.257486 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca448d04-ea6b-4a9e-8134-0d3eebbd1b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.259340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca448d04-ea6b-4a9e-8134-0d3eebbd1b11 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.269331 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1420/2825] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:55.273324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.283251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964f98-f6e0-41e3-bbd5-856f242f0689 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.288014 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.288896 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.289184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.289465 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] PATH_INFO: `/v3/projects/b4951965fdc647f1b24dfa1c241250bf/users/f64845c71a07411fb8f6107a88ec2a99/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.304254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4951965fdc647f1b24dfa1c241250bf, user_id=f64845c71a07411fb8f6107a88ec2a99, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.306889 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.320843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1406/2826] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:55 2022] PUT /identity/v3/projects/b4951965fdc647f1b24dfa1c241250bf/users/f64845c71a07411fb8f6107a88ec2a99/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:24:55.331015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00202a5-95c1-47b5-a92e-0d56456c29e4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.331329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00202a5-95c1-47b5-a92e-0d56456c29e4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.331640 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00202a5-95c1-47b5-a92e-0d56456c29e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.358207 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-c00202a5-95c1-47b5-a92e-0d56456c29e4 None None] MFA Rules not processed for user `f64845c71a07411fb8f6107a88ec2a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:55.359423 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c00202a5-95c1-47b5-a92e-0d56456c29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:55.422885 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1421/2827] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:55.427439 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.496029 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab83121-f9c7-452e-af57-3e83caf2234e admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.501251 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.501904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.502190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.502461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.503154 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.505079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.529840 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1407/2828] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:55 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:24:55.534055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00202a5-95c1-47b5-a92e-0d56456c29e4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.544816 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00202a5-95c1-47b5-a92e-0d56456c29e4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.602318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.602993 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.603274 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.603547 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.604254 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.606153 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.626214 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1422/2829] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:55 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:55.630389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.640849 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7660-8eb3-4bfb-b551-d90f8ef49100 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.645474 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.646442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.646442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.646677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.647761 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.649020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.660809 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1408/2830] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:55.665155 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.676173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab5eb7-b979-4c29-a786-169a9f75e1ef admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.680843 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.681659 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.681948 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.682217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] PATH_INFO: `/v3/projects/6f98540ccdd049af95a60bca8790e58b/users/a4a061755c27464aa9ec66ba9bd5c680/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.696765 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f98540ccdd049af95a60bca8790e58b, user_id=a4a061755c27464aa9ec66ba9bd5c680, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.699415 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.712090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1423/2831] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:55 2022] PUT /identity/v3/projects/6f98540ccdd049af95a60bca8790e58b/users/a4a061755c27464aa9ec66ba9bd5c680/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:55.716074 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.726914 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c398-11db-4b64-a31c-13db2106fbd1 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.787267 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a5f9-c738-488b-acb8-dbd6f35e54fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.787984 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a5f9-c738-488b-acb8-dbd6f35e54fb admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.788265 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a5f9-c738-488b-acb8-dbd6f35e54fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.788536 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a5f9-c738-488b-acb8-dbd6f35e54fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.789255 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a5f9-c738-488b-acb8-dbd6f35e54fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.790899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a5f9-c738-488b-acb8-dbd6f35e54fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.801810 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1409/2832] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:55.808709 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.822374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5cb6-b784-4d39-acee-fae6b27caf76 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:55.827622 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:55.828553 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.828914 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.829208 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] PATH_INFO: `/v3/projects/6f98540ccdd049af95a60bca8790e58b/users/a4a061755c27464aa9ec66ba9bd5c680/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.831224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f98540ccdd049af95a60bca8790e58b, user_id=a4a061755c27464aa9ec66ba9bd5c680, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:55.834387 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:55.845900 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1424/2833] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:55 2022] PUT /identity/v3/projects/6f98540ccdd049af95a60bca8790e58b/users/a4a061755c27464aa9ec66ba9bd5c680/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:55.856108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5daf1c-6b20-419d-a14a-3f4ff4024719 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:55.856622 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5daf1c-6b20-419d-a14a-3f4ff4024719 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:55.856748 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5daf1c-6b20-419d-a14a-3f4ff4024719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:55.864049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:55.886124 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5f5daf1c-6b20-419d-a14a-3f4ff4024719 None None] MFA Rules not processed for user `a4a061755c27464aa9ec66ba9bd5c680`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:55.887388 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5f5daf1c-6b20-419d-a14a-3f4ff4024719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:55.956379 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1410/2834] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:55.967240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:55.969025 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:55.999735 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:56.049040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1604c-b1b1-4d21-b78e-7997a49ea274 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:56.052926 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f9d5-7c77-4e8e-89e4-e22b68c72c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:56.053582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f9d5-7c77-4e8e-89e4-e22b68c72c2d service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:56.053866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f9d5-7c77-4e8e-89e4-e22b68c72c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:56.054141 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f9d5-7c77-4e8e-89e4-e22b68c72c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:56.063951 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7f9d5-7c77-4e8e-89e4-e22b68c72c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:56.065388 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7f9d5-7c77-4e8e-89e4-e22b68c72c2d service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:56.074892 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1425/2835] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:56.101807 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5daf1c-6b20-419d-a14a-3f4ff4024719 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:56.166198 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5daf1c-6b20-419d-a14a-3f4ff4024719 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:56.171142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:56.172061 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:56.172859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:56.173133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] PATH_INFO: `/v3/users/f64845c71a07411fb8f6107a88ec2a99` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:56.174336 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64845c71a07411fb8f6107a88ec2a99)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:56.176301 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:56.226535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64845c71a07411fb8f6107a88ec2a99'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.227163 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64845c71a07411fb8f6107a88ec2a99'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.235451 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64845c71a07411fb8f6107a88ec2a99'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.242818 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64845c71a07411fb8f6107a88ec2a99'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.243454 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64845c71a07411fb8f6107a88ec2a99'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.262007 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1411/2836] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:24:56 2022] DELETE /identity/v3/users/f64845c71a07411fb8f6107a88ec2a99 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:56.266812 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:56.267101 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:56.267381 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:56.284021 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:56.285196 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:56.341903 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1426/2837] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:56.352122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:56.353535 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:56.365764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:56.414152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beac605-48c5-4a0e-8009-921aa3084e94 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:56.417823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:56.418484 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:56.418746 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:56.419018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:56.428678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:56.430088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:56.439471 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1412/2838] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:56.710184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:56.711655 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:56.725119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51274a76-8266-4dd5-ac86-7d16dfd79ab4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:56.732527 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:56.733407 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:56.733695 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:56.733973 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] PATH_INFO: `/v3/projects/b4951965fdc647f1b24dfa1c241250bf` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:56.735297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4951965fdc647f1b24dfa1c241250bf)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:56.737224 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:56.785745 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4951965fdc647f1b24dfa1c241250bf', 'request_id': 'req-64519c47-3be3-49e8-9ae7-851233cba111'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.791787 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4951965fdc647f1b24dfa1c241250bf', 'request_id': 'req-64519c47-3be3-49e8-9ae7-851233cba111'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.797480 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4951965fdc647f1b24dfa1c241250bf', 'request_id': 'req-64519c47-3be3-49e8-9ae7-851233cba111'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.809821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] The token cache is being invalidate because project b4951965fdc647f1b24dfa1c241250bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:24:56.810112 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.810731 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.812309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1427/2839] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:24:56 2022] DELETE /identity/v3/projects/b4951965fdc647f1b24dfa1c241250bf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:56.816376 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:56.826152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91791-51da-4027-acb0-2b59d674ca86 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:56.882583 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:56.883751 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:56.884033 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:56.884306 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] PATH_INFO: `/v3/users/a4a061755c27464aa9ec66ba9bd5c680` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:56.885479 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a061755c27464aa9ec66ba9bd5c680)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:56.887372 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:56.932764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a061755c27464aa9ec66ba9bd5c680'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.933394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a061755c27464aa9ec66ba9bd5c680'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.940538 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a061755c27464aa9ec66ba9bd5c680'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.947452 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a061755c27464aa9ec66ba9bd5c680'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.948120 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-1e2dfa6b-b580-4adf-a671-4e7d83b584b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a061755c27464aa9ec66ba9bd5c680'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:56.966714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1413/2840] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:24:56 2022] DELETE /identity/v3/users/a4a061755c27464aa9ec66ba9bd5c680 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:57.235014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:57.236502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:57.249512 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64519c47-3be3-49e8-9ae7-851233cba111 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:57.282352 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:57.310289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:57.311090 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.311374 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.311683 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] PATH_INFO: `/v3/projects/6f98540ccdd049af95a60bca8790e58b` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.313416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f98540ccdd049af95a60bca8790e58b)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:57.315311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:57.372929 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f98540ccdd049af95a60bca8790e58b', 'request_id': 'req-d6968fe9-13ef-4f0c-bd67-557a08abccc4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:57.379499 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f98540ccdd049af95a60bca8790e58b', 'request_id': 'req-d6968fe9-13ef-4f0c-bd67-557a08abccc4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:57.385285 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f98540ccdd049af95a60bca8790e58b', 'request_id': 'req-d6968fe9-13ef-4f0c-bd67-557a08abccc4'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:57.398315 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] The token cache is being invalidate because project 6f98540ccdd049af95a60bca8790e58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:24:57.398600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:57.399222 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d6968fe9-13ef-4f0c-bd67-557a08abccc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:24:57.400807 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1428/2841] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:24:57 2022] DELETE /identity/v3/projects/6f98540ccdd049af95a60bca8790e58b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:57.406329 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3937-0713-45dd-a830-9fe69274de2e None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.406663 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3937-0713-45dd-a830-9fe69274de2e None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.406946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3937-0713-45dd-a830-9fe69274de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.425448 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-6d0d3937-0713-45dd-a830-9fe69274de2e None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:57.426675 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-6d0d3937-0713-45dd-a830-9fe69274de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:57.452428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:57.487192 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1414/2842] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:57.546702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dffa-967d-4170-a89a-133ac186f4d9 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.547519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dffa-967d-4170-a89a-133ac186f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.547836 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dffa-967d-4170-a89a-133ac186f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.568674 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5466dffa-967d-4170-a89a-133ac186f4d9 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:57.569802 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5466dffa-967d-4170-a89a-133ac186f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:57.577970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1429/2843] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:57.582018 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d3937-0713-45dd-a830-9fe69274de2e None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:57.591838 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d3937-0713-45dd-a830-9fe69274de2e None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:57.596437 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:57.597089 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.597375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.597655 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.598390 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:24:57.598702 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:57.600340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:57.612416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1415/2844] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:24:57.616675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466dffa-967d-4170-a89a-133ac186f4d9 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:57.626648 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466dffa-967d-4170-a89a-133ac186f4d9 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:57.631330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:57.632018 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.632307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.632586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.633544 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:57.635483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:57.665479 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1430/2845] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:57 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:57.669721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:57.680475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891435fc-f22a-4bd5-a4fc-345cfcbbbcbc admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:57.737137 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:57.737806 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.738090 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.738365 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.739048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:57.740983 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:57.761351 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1416/2846] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:57 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:57.765511 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:57.775852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41335618-f35d-4075-bd7b-f3deb587225e admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:57.780530 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:57.781204 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.781476 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.781754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.782483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:57.784157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:57.794510 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1431/2847] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:57.799013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:57.809201 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ac512-8e57-4292-b5ef-1c942f6d1d52 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:57.814447 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cc125-3d17-447e-9979-93cb5a0b77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:57.815097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc125-3d17-447e-9979-93cb5a0b77ef admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.815375 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc125-3d17-447e-9979-93cb5a0b77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.815676 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc125-3d17-447e-9979-93cb5a0b77ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.816425 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cc125-3d17-447e-9979-93cb5a0b77ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:57.817999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cc125-3d17-447e-9979-93cb5a0b77ef admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:57.827999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1417/2848] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:57.831871 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:57.842067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a829da-fcc3-4193-8882-de5f1b295a67 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:57.847324 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:57.848263 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.848545 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.848821 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] PATH_INFO: `/v3/projects/0d2e9d970e964b4abf7ac7581c4e3767/users/e11b374b79ca438ca8a3a686cbf2c355/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.863794 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2e9d970e964b4abf7ac7581c4e3767, user_id=e11b374b79ca438ca8a3a686cbf2c355, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:57.866485 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:57.879501 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1432/2849] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:57 2022] PUT /identity/v3/projects/0d2e9d970e964b4abf7ac7581c4e3767/users/e11b374b79ca438ca8a3a686cbf2c355/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:24:57.889862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96480e15-13de-46df-9fd3-ef5d98373bb1 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:57.890360 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96480e15-13de-46df-9fd3-ef5d98373bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:57.890503 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96480e15-13de-46df-9fd3-ef5d98373bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:57.918042 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-96480e15-13de-46df-9fd3-ef5d98373bb1 None None] MFA Rules not processed for user `e11b374b79ca438ca8a3a686cbf2c355`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:57.919266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-96480e15-13de-46df-9fd3-ef5d98373bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:57.983924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1418/2850] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:57.988958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.052577 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487b96-d271-4736-8ba1-52423435e10a admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.057558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.058215 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.058495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.058763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.059467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.061395 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.064687 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:58.088631 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1433/2851] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:24:57 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:58.092559 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96480e15-13de-46df-9fd3-ef5d98373bb1 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.103649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96480e15-13de-46df-9fd3-ef5d98373bb1 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.127969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:58.161969 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.162648 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.162937 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.163218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.163953 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.165862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.185643 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1419/2852] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:24:58 2022] POST /identity/v3/users => generated 311 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:24:58.189600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.199909 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7b0de-bd77-4b4b-a1b9-9457b544f051 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.205119 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.205783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.206063 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.206344 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.207311 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.208830 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.220757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1434/2853] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:24:58.224742 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.234691 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205ccf7-7d32-4a48-ba58-63af57f5a7dd admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.239266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.240183 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.240460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.240730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] PATH_INFO: `/v3/projects/d48626e95267484eb80d085d47394d57/users/2884e82347b44fed9b93d6a17ddbaec0/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.255069 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48626e95267484eb80d085d47394d57, user_id=2884e82347b44fed9b93d6a17ddbaec0, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.258072 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.271650 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1420/2854] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:58 2022] PUT /identity/v3/projects/d48626e95267484eb80d085d47394d57/users/2884e82347b44fed9b93d6a17ddbaec0/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:24:58.275639 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.286625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317ba9-c021-4641-99f9-a80fe0142542 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.342092 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31f410-38d0-4f43-ac88-d34cbca97c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.342679 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f410-38d0-4f43-ac88-d34cbca97c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.342958 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f410-38d0-4f43-ac88-d34cbca97c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.343229 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f410-38d0-4f43-ac88-d34cbca97c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.344565 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31f410-38d0-4f43-ac88-d34cbca97c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.346167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31f410-38d0-4f43-ac88-d34cbca97c30 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.355809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1435/2855] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 10:24:58.360081 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.370562 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb19b7-5525-4125-893e-c83991e40987 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.375239 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.376156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.376446 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.376728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] PATH_INFO: `/v3/projects/d48626e95267484eb80d085d47394d57/users/2884e82347b44fed9b93d6a17ddbaec0/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.378728 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48626e95267484eb80d085d47394d57, user_id=2884e82347b44fed9b93d6a17ddbaec0, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.381387 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.392616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1421/2856] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:24:58 2022] PUT /identity/v3/projects/d48626e95267484eb80d085d47394d57/users/2884e82347b44fed9b93d6a17ddbaec0/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:24:58.402696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61605adc-8bb0-43f1-bee5-5a65a8425bac None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.402965 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61605adc-8bb0-43f1-bee5-5a65a8425bac None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.403301 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61605adc-8bb0-43f1-bee5-5a65a8425bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.429959 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-61605adc-8bb0-43f1-bee5-5a65a8425bac None None] MFA Rules not processed for user `2884e82347b44fed9b93d6a17ddbaec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:24:58.431162 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-61605adc-8bb0-43f1-bee5-5a65a8425bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:58.498087 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1436/2857] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:24:58.509156 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.510912 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:24:58.570077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ae34-4fd8-417f-8174-a9d5126ba68b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.573797 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.574453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.574740 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.575017 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.585345 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.586784 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.596524 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1422/2858] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:24:58.741828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61605adc-8bb0-43f1-bee5-5a65a8425bac None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:24:58.751988 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61605adc-8bb0-43f1-bee5-5a65a8425bac None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:24:58.755658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882236a-0a29-4cc5-96ff-dd867397aed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:24:58.756298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882236a-0a29-4cc5-96ff-dd867397aed7 service cinder] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:24:58.756584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882236a-0a29-4cc5-96ff-dd867397aed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:24:58.756860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882236a-0a29-4cc5-96ff-dd867397aed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:24:58.810930 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:24:58.816531 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882236a-0a29-4cc5-96ff-dd867397aed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:24:58.818304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882236a-0a29-4cc5-96ff-dd867397aed7 service cinder] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:24:58.827546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1437/2859] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:24:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 10:25:04.034036 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:04.097693 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3ecb4-d3ae-4f2f-93b4-da2b24c29db5 service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:04.102223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:04.103095 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:04.103377 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:04.103678 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] PATH_INFO: `/v3/users/e11b374b79ca438ca8a3a686cbf2c355` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:04.104859 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11b374b79ca438ca8a3a686cbf2c355)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:04.106757 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:04.130068 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:04.155665 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11b374b79ca438ca8a3a686cbf2c355'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.156396 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11b374b79ca438ca8a3a686cbf2c355'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.163814 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11b374b79ca438ca8a3a686cbf2c355'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.170704 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11b374b79ca438ca8a3a686cbf2c355'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.171337 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11b374b79ca438ca8a3a686cbf2c355'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.189498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1423/2860] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:25:04 2022] DELETE /identity/v3/users/e11b374b79ca438ca8a3a686cbf2c355 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:04.193969 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:04.194450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:04.194551 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:04.211197 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:04.212439 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:04.272814 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1438/2861] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:04.282315 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:04.283775 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:04.341434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57217-9509-42ad-a5de-a8df8f858494 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:04.345142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:04.345791 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:04.346076 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:04.346354 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:04.355361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:04.356846 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:04.366817 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1424/2862] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:04.639630 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:04.641217 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:04.653296 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee00fd1-ce15-41bc-98ac-01b413242aa2 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:04.658841 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:04.659514 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:04.659869 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:04.660193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] PATH_INFO: `/v3/projects/0d2e9d970e964b4abf7ac7581c4e3767` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:04.661450 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2e9d970e964b4abf7ac7581c4e3767)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:04.663372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:04.710913 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2e9d970e964b4abf7ac7581c4e3767', 'request_id': 'req-26034cb1-5105-48cd-88a5-2cfef3dfd3da'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.717015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2e9d970e964b4abf7ac7581c4e3767', 'request_id': 'req-26034cb1-5105-48cd-88a5-2cfef3dfd3da'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.723241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2e9d970e964b4abf7ac7581c4e3767', 'request_id': 'req-26034cb1-5105-48cd-88a5-2cfef3dfd3da'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.735963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] The token cache is being invalidate because project 0d2e9d970e964b4abf7ac7581c4e3767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:25:04.736251 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.736877 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.738418 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1439/2863] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:25:04 2022] DELETE /identity/v3/projects/0d2e9d970e964b4abf7ac7581c4e3767 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:04.742445 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:04.752234 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83296c15-b794-471a-b948-4a554c13571f service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:04.810021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:04.810899 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:04.811184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:04.811460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] PATH_INFO: `/v3/users/2884e82347b44fed9b93d6a17ddbaec0` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:04.812710 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2884e82347b44fed9b93d6a17ddbaec0)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:04.814684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:04.860159 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:04.861582 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2884e82347b44fed9b93d6a17ddbaec0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.862392 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2884e82347b44fed9b93d6a17ddbaec0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.870348 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2884e82347b44fed9b93d6a17ddbaec0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.878223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2884e82347b44fed9b93d6a17ddbaec0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.878927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-754f11f8-21b2-44f5-ac69-e5de0c539df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2884e82347b44fed9b93d6a17ddbaec0'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:04.896808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1425/2864] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:25:04 2022] DELETE /identity/v3/users/2884e82347b44fed9b93d6a17ddbaec0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:05.167970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.169421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:05.182412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26034cb1-5105-48cd-88a5-2cfef3dfd3da admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.240157 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.241023 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.241307 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.241584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] PATH_INFO: `/v3/projects/d48626e95267484eb80d085d47394d57` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.242784 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48626e95267484eb80d085d47394d57)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.244729 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.266981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:05.292469 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48626e95267484eb80d085d47394d57', 'request_id': 'req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:05.298438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48626e95267484eb80d085d47394d57', 'request_id': 'req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:05.303924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48626e95267484eb80d085d47394d57', 'request_id': 'req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:05.317852 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] The token cache is being invalidate because project d48626e95267484eb80d085d47394d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:25:05.318138 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:05.318754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-d7a39fd8-d49e-41c2-8793-f50d3c1ebd7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:05.320519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1440/2865] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:25:05 2022] DELETE /identity/v3/projects/d48626e95267484eb80d085d47394d57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:05.325529 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e64929-6dcd-4de2-b34f-a1c80548e643 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.326043 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e64929-6dcd-4de2-b34f-a1c80548e643 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.326160 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e64929-6dcd-4de2-b34f-a1c80548e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.344790 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-74e64929-6dcd-4de2-b34f-a1c80548e643 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:05.345990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-74e64929-6dcd-4de2-b34f-a1c80548e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:05.407024 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1426/2866] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:05.415336 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c4f55-786b-4771-80d5-89d1a99fbeac None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.415569 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c4f55-786b-4771-80d5-89d1a99fbeac None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.415887 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c4f55-786b-4771-80d5-89d1a99fbeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.434095 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-b26c4f55-786b-4771-80d5-89d1a99fbeac None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:05.435298 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-b26c4f55-786b-4771-80d5-89d1a99fbeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:05.443828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1441/2867] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:05.448000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e64929-6dcd-4de2-b34f-a1c80548e643 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.458422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e64929-6dcd-4de2-b34f-a1c80548e643 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.463041 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.463735 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.464021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.464297 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] PATH_INFO: `/v3/domains` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.465021 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80353) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:25:05.465328 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.466924 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.478476 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1427/2868] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:25:05.482717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c4f55-786b-4771-80d5-89d1a99fbeac None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.491963 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c4f55-786b-4771-80d5-89d1a99fbeac None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.496657 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.497305 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.497586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.497860 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.498571 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.501015 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.537160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1442/2869] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:25:05 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:25:05.539184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.549841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dc78-8d3f-4951-a513-882e28fb841d admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.608463 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.609182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.609475 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.609753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.610458 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.612399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.633681 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1428/2870] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:25:05 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 10:25:05.637801 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.649779 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40089a35-194a-4c4e-96a4-f8f60a589396 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.654383 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.655035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.655322 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.655621 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.656377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.657962 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.668506 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1443/2871] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:05.672951 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.683125 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827196-a925-4416-8cca-292ac83cd170 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.688486 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989e76a-1e68-4d3a-9f86-6730a1e2cbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.689150 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989e76a-1e68-4d3a-9f86-6730a1e2cbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.689434 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989e76a-1e68-4d3a-9f86-6730a1e2cbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.689709 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989e76a-1e68-4d3a-9f86-6730a1e2cbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.690443 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989e76a-1e68-4d3a-9f86-6730a1e2cbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.692079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989e76a-1e68-4d3a-9f86-6730a1e2cbc1 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.703204 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1429/2872] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:05.707275 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.717401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da051d-dfe0-48ce-8c46-baec39d60811 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.722326 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.723220 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.723502 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.723834 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] PATH_INFO: `/v3/projects/13ceda337d6d4285bb98d71798d18d1d/users/eaf8516f894c444f85db840ffde6c73a/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.741201 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ceda337d6d4285bb98d71798d18d1d, user_id=eaf8516f894c444f85db840ffde6c73a, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.744085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.758908 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1444/2873] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:25:05 2022] PUT /identity/v3/projects/13ceda337d6d4285bb98d71798d18d1d/users/eaf8516f894c444f85db840ffde6c73a/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:05.769696 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d449-7318-4c40-86c2-7759365ec021 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.769939 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d449-7318-4c40-86c2-7759365ec021 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.770219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d449-7318-4c40-86c2-7759365ec021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.800533 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9752d449-7318-4c40-86c2-7759365ec021 None None] MFA Rules not processed for user `eaf8516f894c444f85db840ffde6c73a`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:05.801802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9752d449-7318-4c40-86c2-7759365ec021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:05.819903 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:05.871065 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1430/2874] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:05.876176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.941167 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a461-6d9d-4327-a200-d903efd40cdd admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:05.945831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:05.946483 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:05.946763 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:05.947032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:05.947764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:05.951999 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:05.976142 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1445/2875] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:25:05 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:25:05.980048 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d449-7318-4c40-86c2-7759365ec021 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:05.991492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d449-7318-4c40-86c2-7759365ec021 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:06.053792 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:06.054467 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.054756 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.055032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] PATH_INFO: `/v3/users` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.055768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:06.057670 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:06.078032 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1431/2876] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:25:05 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:25:06.081985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:06.092345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6674fad-ce04-4f71-b491-6c499e1bf6d4 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:06.097672 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:06.098329 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.098616 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.098899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.099721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:06.101333 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:06.112761 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1446/2877] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:06.117075 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:06.127152 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4165f7-02b5-48f6-a725-3d511541f341 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:06.131801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:06.132948 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.133231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.133509 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] PATH_INFO: `/v3/projects/58f8f3f88c65461092bfeee8438d57bf/users/1be012acdbd24ef2a8e925b5fad10f26/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.147999 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f8f3f88c65461092bfeee8438d57bf, user_id=1be012acdbd24ef2a8e925b5fad10f26, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:06.150627 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:06.164220 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1432/2878] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:25:06 2022] PUT /identity/v3/projects/58f8f3f88c65461092bfeee8438d57bf/users/1be012acdbd24ef2a8e925b5fad10f26/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:06.168172 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:06.178910 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370ba1b-2e76-45a7-b831-735c73e18446 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:06.191068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:06.235772 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c980-dfa8-4ff0-9625-812e99f7951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:06.236343 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c980-dfa8-4ff0-9625-812e99f7951d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.236625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c980-dfa8-4ff0-9625-812e99f7951d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.236901 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c980-dfa8-4ff0-9625-812e99f7951d admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.237764 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c980-dfa8-4ff0-9625-812e99f7951d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:06.239361 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c980-dfa8-4ff0-9625-812e99f7951d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:06.249363 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1447/2879] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:06.253620 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:06.264656 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc6b28-a385-4be4-a4b8-e41d0d772903 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:06.269324 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:06.270209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.270498 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.270777 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] PATH_INFO: `/v3/projects/58f8f3f88c65461092bfeee8438d57bf/users/1be012acdbd24ef2a8e925b5fad10f26/roles/751630036fa149ecb8a57e9a6c98cca9` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.272794 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f8f3f88c65461092bfeee8438d57bf, user_id=1be012acdbd24ef2a8e925b5fad10f26, role_id=751630036fa149ecb8a57e9a6c98cca9)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:06.275427 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:06.286199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1433/2880] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:25:06 2022] PUT /identity/v3/projects/58f8f3f88c65461092bfeee8438d57bf/users/1be012acdbd24ef2a8e925b5fad10f26/roles/751630036fa149ecb8a57e9a6c98cca9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:06.297747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e51ca-cf8f-40d9-89af-07ae523541b9 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.298035 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e51ca-cf8f-40d9-89af-07ae523541b9 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.298334 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e51ca-cf8f-40d9-89af-07ae523541b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.324088 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-927e51ca-cf8f-40d9-89af-07ae523541b9 None None] MFA Rules not processed for user `1be012acdbd24ef2a8e925b5fad10f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:06.325272 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-927e51ca-cf8f-40d9-89af-07ae523541b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:06.393003 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1448/2881] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:06.403565 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:06.405716 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:06.464190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4fb43-33ef-4b1d-8a0d-334725fd44c0 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:06.467877 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d68ea-1de5-4954-9008-b657d52b4e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:06.469122 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d68ea-1de5-4954-9008-b657d52b4e0d service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.469405 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d68ea-1de5-4954-9008-b657d52b4e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.469677 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d68ea-1de5-4954-9008-b657d52b4e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.478602 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d68ea-1de5-4954-9008-b657d52b4e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:06.480088 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d68ea-1de5-4954-9008-b657d52b4e0d service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:06.489564 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1434/2882] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:06.844858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e51ca-cf8f-40d9-89af-07ae523541b9 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:06.910552 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e51ca-cf8f-40d9-89af-07ae523541b9 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:06.915108 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:06.916008 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:06.916297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:06.916575 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] PATH_INFO: `/v3/users/eaf8516f894c444f85db840ffde6c73a` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:06.917775 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf8516f894c444f85db840ffde6c73a)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:06.919736 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:06.960129 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:06.965516 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf8516f894c444f85db840ffde6c73a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:06.973076 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf8516f894c444f85db840ffde6c73a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:06.973810 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf8516f894c444f85db840ffde6c73a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:06.974441 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf8516f894c444f85db840ffde6c73a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:06.981420 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf8516f894c444f85db840ffde6c73a'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:06.998367 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1449/2883] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:25:06 2022] DELETE /identity/v3/users/eaf8516f894c444f85db840ffde6c73a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:07.003373 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:07.003703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:07.003986 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:07.022460 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:07.023698 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:07.031753 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:07.086581 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1435/2884] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 10:25:07.097858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:07.099596 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:07.160358 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53a119-bec8-4d83-9c21-306c2dee2a14 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:07.164122 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:07.164773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:07.165055 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:07.165330 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:07.176093 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:07.177546 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:07.187287 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1450/2885] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:07.493837 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:07.495325 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:07.509407 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c30dad-b625-43b1-aaef-617469576aea None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:07.514864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:07.516077 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:07.516504 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:07.516823 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] PATH_INFO: `/v3/projects/13ceda337d6d4285bb98d71798d18d1d` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:07.518006 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ceda337d6d4285bb98d71798d18d1d)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:07.519891 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:07.571505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ceda337d6d4285bb98d71798d18d1d', 'request_id': 'req-05b5e1ed-4532-4389-a240-6543df22e223'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.580359 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ceda337d6d4285bb98d71798d18d1d', 'request_id': 'req-05b5e1ed-4532-4389-a240-6543df22e223'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.586428 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ceda337d6d4285bb98d71798d18d1d', 'request_id': 'req-05b5e1ed-4532-4389-a240-6543df22e223'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.598598 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] The token cache is being invalidate because project 13ceda337d6d4285bb98d71798d18d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:25:07.598910 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.599557 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.601142 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1436/2886] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:25:07 2022] DELETE /identity/v3/projects/13ceda337d6d4285bb98d71798d18d1d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:07.605176 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:07.615592 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793f08-4b4c-4f15-b602-d23c1b31e32e service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:07.679702 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:07.680574 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:07.680856 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:07.681132 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] PATH_INFO: `/v3/users/1be012acdbd24ef2a8e925b5fad10f26` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:07.682362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be012acdbd24ef2a8e925b5fad10f26)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:07.684338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:07.734647 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be012acdbd24ef2a8e925b5fad10f26'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.744350 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be012acdbd24ef2a8e925b5fad10f26'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.744986 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be012acdbd24ef2a8e925b5fad10f26'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.745593 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be012acdbd24ef2a8e925b5fad10f26'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.753377 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-f0a971b9-d334-4ce0-a375-cee147464b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be012acdbd24ef2a8e925b5fad10f26'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:07.754733 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:07.778595 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1451/2887] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:25:07 2022] DELETE /identity/v3/users/1be012acdbd24ef2a8e925b5fad10f26 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:08.066461 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.067940 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:08.081525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5e1ed-4532-4389-a240-6543df22e223 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.139422 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.140219 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.140499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.140774 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] PATH_INFO: `/v3/projects/58f8f3f88c65461092bfeee8438d57bf` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.142604 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f8f3f88c65461092bfeee8438d57bf)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.144647 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.188729 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:08.196493 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f8f3f88c65461092bfeee8438d57bf', 'request_id': 'req-3ca4e33c-c733-4a15-9d34-c2be4426a032'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:08.204305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f8f3f88c65461092bfeee8438d57bf', 'request_id': 'req-3ca4e33c-c733-4a15-9d34-c2be4426a032'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:08.209861 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f8f3f88c65461092bfeee8438d57bf', 'request_id': 'req-3ca4e33c-c733-4a15-9d34-c2be4426a032'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:08.221499 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] The token cache is being invalidate because project 58f8f3f88c65461092bfeee8438d57bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:25:08.221852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:08.222579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-3ca4e33c-c733-4a15-9d34-c2be4426a032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:08.224190 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1437/2888] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:25:08 2022] DELETE /identity/v3/projects/58f8f3f88c65461092bfeee8438d57bf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:08.229159 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f18ad-510f-49b0-8fb8-aa570515cac4 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.229467 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f18ad-510f-49b0-8fb8-aa570515cac4 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.229743 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f18ad-510f-49b0-8fb8-aa570515cac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.249365 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5a8f18ad-510f-49b0-8fb8-aa570515cac4 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:08.250586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5a8f18ad-510f-49b0-8fb8-aa570515cac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:08.311085 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1452/2889] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:08.319605 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a584b-5c61-4d05-9fff-766249292ee5 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.319904 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a584b-5c61-4d05-9fff-766249292ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.320186 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a584b-5c61-4d05-9fff-766249292ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.461218 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-770a584b-5c61-4d05-9fff-766249292ee5 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:08.462441 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-770a584b-5c61-4d05-9fff-766249292ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:08.470401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1438/2890] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:08.474675 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f18ad-510f-49b0-8fb8-aa570515cac4 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.484633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f18ad-510f-49b0-8fb8-aa570515cac4 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.489267 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.489924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.490209 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.490487 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.491252 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:25:08.491606 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.493189 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.506693 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1453/2891] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:25:08.511274 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a584b-5c61-4d05-9fff-766249292ee5 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.526862 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a584b-5c61-4d05-9fff-766249292ee5 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.531764 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.532424 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.532706 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.532979 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.533666 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.535552 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.560505 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1439/2892] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:25:08 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:25:08.565783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.576192 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894329-64ce-4a72-81e9-763f10115f65 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.631828 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.632782 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.633022 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.633300 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.633994 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.635950 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.655976 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1454/2893] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:25:08 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:25:08.660049 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.670616 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d814e-cbd0-46e4-abc9-0ade10ee2ea4 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.675856 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.676517 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.676805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.677110 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.677841 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.679416 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.689955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1440/2894] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:08.693902 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.703899 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003e9d-bd5e-4ad2-bccc-dcc9fd4d3c5f admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.708747 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347617d-2845-4271-b943-f19b6d1775a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.709399 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347617d-2845-4271-b943-f19b6d1775a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.709686 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347617d-2845-4271-b943-f19b6d1775a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.709966 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347617d-2845-4271-b943-f19b6d1775a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.710718 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347617d-2845-4271-b943-f19b6d1775a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.712416 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347617d-2845-4271-b943-f19b6d1775a6 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.722241 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1455/2895] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:08.726223 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.736579 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39737ed-1113-4308-b646-de22b9e8b252 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.741276 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.742153 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.742442 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.742721 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] PATH_INFO: `/v3/projects/2e511a843c7c43c8ae66dd09c281210e/users/2a776adf16f649329a8218fd625c1692/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.757990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e511a843c7c43c8ae66dd09c281210e, user_id=2a776adf16f649329a8218fd625c1692, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.760641 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.773768 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1441/2896] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:25:08 2022] PUT /identity/v3/projects/2e511a843c7c43c8ae66dd09c281210e/users/2a776adf16f649329a8218fd625c1692/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:08.784199 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42853-4e51-4689-b548-eb41764ecd96 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.784490 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42853-4e51-4689-b548-eb41764ecd96 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.784770 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42853-4e51-4689-b548-eb41764ecd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.812708 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-97e42853-4e51-4689-b548-eb41764ecd96 None None] MFA Rules not processed for user `2a776adf16f649329a8218fd625c1692`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:08.814496 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-97e42853-4e51-4689-b548-eb41764ecd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:08.846970 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:08.880598 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1456/2897] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:08.891966 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:08.893718 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:08.971394 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda328d-254f-43da-a62c-eba3fe1578fb admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:08.975009 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454a97d-3c4a-457e-ab6a-c67452e126ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:08.975692 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a97d-3c4a-457e-ab6a-c67452e126ef service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:08.976008 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a97d-3c4a-457e-ab6a-c67452e126ef service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:08.976291 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a97d-3c4a-457e-ab6a-c67452e126ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:08.985262 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454a97d-3c4a-457e-ab6a-c67452e126ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:08.986684 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454a97d-3c4a-457e-ab6a-c67452e126ef service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:08.995508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1442/2898] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:18.877378 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=11 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:18.991548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=72,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:26.490239 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e42853-4e51-4689-b548-eb41764ecd96 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:26.551721 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e42853-4e51-4689-b548-eb41764ecd96 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:26.556289 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:26.557168 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:26.557447 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:26.557720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] PATH_INFO: `/v3/users/2a776adf16f649329a8218fd625c1692` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:26.558939 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a776adf16f649329a8218fd625c1692)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:26.560906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:26.610548 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a776adf16f649329a8218fd625c1692'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:26.617757 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a776adf16f649329a8218fd625c1692'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:26.618412 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a776adf16f649329a8218fd625c1692'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:26.619014 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a776adf16f649329a8218fd625c1692'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:26.625979 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a776adf16f649329a8218fd625c1692'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:26.643797 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1457/2899] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:25:26 2022] DELETE /identity/v3/users/2a776adf16f649329a8218fd625c1692 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:26.648303 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:26.648803 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:26.648916 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:26.666548 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:26.667781 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:26.725161 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1443/2900] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:26.734611 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:26.736050 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:26.793338 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c600a-6e50-4e2c-b15e-3ee607084ad5 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:26.796981 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574680-4290-4427-8199-47a77bfa05ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:26.797625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574680-4290-4427-8199-47a77bfa05ca service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:26.797906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574680-4290-4427-8199-47a77bfa05ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:26.798184 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574680-4290-4427-8199-47a77bfa05ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:26.807419 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574680-4290-4427-8199-47a77bfa05ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:26.808878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574680-4290-4427-8199-47a77bfa05ca service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:26.818276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1458/2901] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:27.093343 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.094990 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:27.109850 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0273c-8b10-4aaf-be6b-e7ed8128f806 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.114802 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.115766 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.116020 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.116286 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] PATH_INFO: `/v3/projects/2e511a843c7c43c8ae66dd09c281210e` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.117483 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e511a843c7c43c8ae66dd09c281210e)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.119381 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.167374 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e511a843c7c43c8ae66dd09c281210e', 'request_id': 'req-29920d59-8b92-453a-ae90-e33f0883fcfe'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:27.174782 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e511a843c7c43c8ae66dd09c281210e', 'request_id': 'req-29920d59-8b92-453a-ae90-e33f0883fcfe'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:27.180542 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e511a843c7c43c8ae66dd09c281210e', 'request_id': 'req-29920d59-8b92-453a-ae90-e33f0883fcfe'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:27.192453 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] The token cache is being invalidate because project 2e511a843c7c43c8ae66dd09c281210e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80353) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:25:27.192737 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:27.193362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-29920d59-8b92-453a-ae90-e33f0883fcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:25:27.194883 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1444/2902] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:25:27 2022] DELETE /identity/v3/projects/2e511a843c7c43c8ae66dd09c281210e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 10:25:27.199754 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e5b85-7065-470c-9328-db2aa1bb028f None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.200043 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e5b85-7065-470c-9328-db2aa1bb028f None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.200316 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e5b85-7065-470c-9328-db2aa1bb028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.218696 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-5a9e5b85-7065-470c-9328-db2aa1bb028f None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:27.220040 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-5a9e5b85-7065-470c-9328-db2aa1bb028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:27.237304 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:27.283345 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1459/2903] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:27.290822 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a973-7a6c-44fd-bc86-3bc6cf3056c3 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.291108 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a973-7a6c-44fd-bc86-3bc6cf3056c3 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.291412 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a973-7a6c-44fd-bc86-3bc6cf3056c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.309146 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-9396a973-7a6c-44fd-bc86-3bc6cf3056c3 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:27.310335 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9396a973-7a6c-44fd-bc86-3bc6cf3056c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:27.318852 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1445/2904] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:27.322878 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e5b85-7065-470c-9328-db2aa1bb028f None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.333173 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e5b85-7065-470c-9328-db2aa1bb028f None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.337783 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.338438 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.338724 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.339004 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.339796 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80354) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 10:25:27.340106 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.341715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.353357 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1460/2905] 10.222.0.78 () {58 vars in 1152 bytes} [Mon Jul 4 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 10:25:27.357525 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396a973-7a6c-44fd-bc86-3bc6cf3056c3 None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.367462 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396a973-7a6c-44fd-bc86-3bc6cf3056c3 None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.372139 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.372788 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.373067 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.373340 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.374025 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.375920 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.401876 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1446/2906] 10.222.0.78 () {60 vars in 1152 bytes} [Mon Jul 4 10:25:27 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:25:27.406160 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.416444 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef391ab-0ab2-4a98-aa98-18d389e66e7d admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.471706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.472379 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.472658 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.472931 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.473619 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.475519 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.496193 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1461/2907] 10.222.0.78 () {60 vars in 1143 bytes} [Mon Jul 4 10:25:27 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 10:25:27.500361 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.511520 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29974c-f9dc-4ed9-a2b0-8fb81aa0df18 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.516283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.516947 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.517228 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.517554 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.518283 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.519950 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.530230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1447/2908] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:27.534212 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.544362 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421f7ee-a566-4134-ab57-ab50989f57c1 admin admin] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.549855 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46552-209a-447f-937b-b98be3c7930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.550427 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46552-209a-447f-937b-b98be3c7930b admin admin] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.550715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46552-209a-447f-937b-b98be3c7930b admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.550991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46552-209a-447f-937b-b98be3c7930b admin admin] PATH_INFO: `/v3/roles` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.551755 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46552-209a-447f-937b-b98be3c7930b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.553349 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46552-209a-447f-937b-b98be3c7930b admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.563408 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1462/2909] 10.222.0.78 () {58 vars in 1121 bytes} [Mon Jul 4 10:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 10:25:27.568206 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.578244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a989c2-5672-49e3-b0b0-38525b00d873 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.582703 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.583668 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.583946 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.584216 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] PATH_INFO: `/v3/projects/2a0a67bf91ec461e860413539f25b6dc/users/90dd97df1c604430bf02cde0b2bdd414/roles/b70d42d686f74daf87804f3a36b591a5` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.598603 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0a67bf91ec461e860413539f25b6dc, user_id=90dd97df1c604430bf02cde0b2bdd414, role_id=b70d42d686f74daf87804f3a36b591a5)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.601231 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.613918 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1448/2910] 10.222.0.78 () {60 vars in 1482 bytes} [Mon Jul 4 10:25:27 2022] PUT /identity/v3/projects/2a0a67bf91ec461e860413539f25b6dc/users/90dd97df1c604430bf02cde0b2bdd414/roles/b70d42d686f74daf87804f3a36b591a5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:25:27.619200 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050b0c-edd4-45cd-85e5-ceb2a9020eb8 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.619495 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050b0c-edd4-45cd-85e5-ceb2a9020eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.619820 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57050b0c-edd4-45cd-85e5-ceb2a9020eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.638268 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-57050b0c-edd4-45cd-85e5-ceb2a9020eb8 None None] MFA Rules not processed for user `657ce8ca189845ff90a9f70d2e00122f`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:27.639454 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-57050b0c-edd4-45cd-85e5-ceb2a9020eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:27.698187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1463/2911] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:27.707805 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:27.709523 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:27.731831 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:27.768901 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91ed5d-d91d-47a5-a1e8-edc33704e278 admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:27.772563 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:27.773209 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:27.773492 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:27.773767 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:27.782635 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:27.784712 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:27.793975 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1449/2912] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:28.397991 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728ff7-3fa5-4ca9-b679-42cdb13c567a None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:28.398421 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728ff7-3fa5-4ca9-b679-42cdb13c567a None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:28.398706 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728ff7-3fa5-4ca9-b679-42cdb13c567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:28.427720 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-d1728ff7-3fa5-4ca9-b679-42cdb13c567a None None] MFA Rules not processed for user `90dd97df1c604430bf02cde0b2bdd414`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:28.428924 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-d1728ff7-3fa5-4ca9-b679-42cdb13c567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:28.446318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:28.498148 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1464/2913] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:28.509801 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:28.511199 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:28.574171 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d34a8-1c76-403f-a1a7-eb7c1ee1ece8 service neutron] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:28.578489 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8bee133d6a4583a31c87aa4d4af927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:28.579000 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:28.579362 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:28.579690 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:28.589596 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:28.591013 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:28.600338 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1450/2914] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:29.949067 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:29.949591 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:29.949715 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:29.967376 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] MFA Rules not processed for user `90dd97df1c604430bf02cde0b2bdd414`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:29.968582 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:29.976161 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1465/2915] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:30.016230 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:30.018455 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:30.073843 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fae4eb-f2a2-4b81-8534-d97b7682730c service cinder] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:30.077501 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34e1bd13b2094b93b41f10f209660b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:30.078145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:30.078430 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:30.078708 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:30.081182 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:30.160269 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=100 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:30.162847 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:30.164808 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:30.176155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1451/2916] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:30.384474 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:30.385873 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:30.398007 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13891fc-a638-421b-98d3-beb4c2e02cf3 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:30.401633 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:30.402276 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:30.402558 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:30.402831 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:30.404601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:30.416072 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:30.417425 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:30.426032 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1466/2917] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:30.743266 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:30.744731 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:30.747218 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:30.756116 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e59ba-8e05-4a9a-8646-f9f3c2ef4661 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:30.760694 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:30.761340 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:30.761625 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:30.761907 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:30.763771 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:30.777858 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:30.779291 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:30.791309 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1467/2918] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:30.820401 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed34dc-8408-43f5-9c00-163aca76bee8 service glance] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:30.825680 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:30.826399 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:30.826744 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:30.827079 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:30.828972 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:30.841168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:30.842719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:30.853145 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1452/2919] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:32.556146 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:32.564954 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bac87-d8c1-4e0e-8070-fe9c9e1a6335 service neutron] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:32.568581 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862188-0ba2-4d69-937c-375d7ff89a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b5399fad924cabaf1d414bbca2c191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:32.569210 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862188-0ba2-4d69-937c-375d7ff89a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:32.569489 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862188-0ba2-4d69-937c-375d7ff89a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:32.569762 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862188-0ba2-4d69-937c-375d7ff89a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:32.571525 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-9d862188-0ba2-4d69-937c-375d7ff89a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:32.581866 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862188-0ba2-4d69-937c-375d7ff89a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:32.583297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862188-0ba2-4d69-937c-375d7ff89a0e service neutron] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:32.591550 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1468/2920] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:33.276414 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:25:33.278254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:33.295558 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc90dab-1f4f-4156-a6be-806f8172d7ed service placement] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:25:33.301087 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f53df-16be-4d01-bcf6-72989736e578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a63afc7b9514ef7b4d799b1c1538b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:25:33.301799 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f53df-16be-4d01-bcf6-72989736e578 service nova] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:33.302148 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f53df-16be-4d01-bcf6-72989736e578 service nova] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:33.302508 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f53df-16be-4d01-bcf6-72989736e578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:33.304364 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-9d4f53df-16be-4d01-bcf6-72989736e578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:33.317226 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f53df-16be-4d01-bcf6-72989736e578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:25:33.318955 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f53df-16be-4d01-bcf6-72989736e578 service nova] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:25:33.331263 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1453/2921] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:25:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:25:42.587809 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=40 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:43.326694 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=40 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:25:46.505584 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] REQUEST_METHOD: `POST` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:25:46.506071 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:25:46.506188 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:25:46.524401 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.auth.core [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] MFA Rules not processed for user `90dd97df1c604430bf02cde0b2bdd414`. Rule list: `[]` (Enabled: `True`). {{(pid=80354) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:25:46.525601 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:25:46.532602 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1469/2922] 10.222.0.78 () {58 vars in 957 bytes} [Mon Jul 4 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:25:56.518748 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=3 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:26:04.734660 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186e38-ebc9-419c-b061-37aac8381ee6 None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:26:04.735305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186e38-ebc9-419c-b061-37aac8381ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:26:04.735305 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186e38-ebc9-419c-b061-37aac8381ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:26:04.754184 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-b0186e38-ebc9-419c-b061-37aac8381ee6 None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:26:04.755386 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-b0186e38-ebc9-419c-b061-37aac8381ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:26:04.810593 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1454/2923] 10.222.0.78 () {58 vars in 1009 bytes} [Mon Jul 4 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:26:04.856750 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:26:04.858281 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.fernet_utils [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80354) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:26:04.943488 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dea621-0418-488c-bd97-772ca87368a6 None None] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:26:04.948717 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f056f-f951-434f-89cd-87725edade2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:26:04.949372 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f056f-f951-434f-89cd-87725edade2f service swift] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:26:04.949661 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f056f-f951-434f-89cd-87725edade2f service swift] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:26:04.949941 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f056f-f951-434f-89cd-87725edade2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:26:04.958597 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f056f-f951-434f-89cd-87725edade2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:26:04.960226 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f056f-f951-434f-89cd-87725edade2f service swift] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:26:04.968240 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1470/2924] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:26:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:26:14.803341 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=25 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:26:14.965016 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=37 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:26:20.324580 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8de8-97ea-4848-a343-d1bbf377e87c None None] REQUEST_METHOD: `POST` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:26:20.325035 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8de8-97ea-4848-a343-d1bbf377e87c None None] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:26:20.325133 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8de8-97ea-4848-a343-d1bbf377e87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:26:20.342436 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.auth.core [None req-5a7f8de8-97ea-4848-a343-d1bbf377e87c None None] MFA Rules not processed for user `15dfaee01d964b2d9ed52e4474a99863`. Rule list: `[]` (Enabled: `True`). {{(pid=80353) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 10:26:20.343632 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-5a7f8de8-97ea-4848-a343-d1bbf377e87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:26:20.351168 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1455/2925] 10.222.0.78 () {58 vars in 967 bytes} [Mon Jul 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 10:26:20.363773 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f056f-f951-434f-89cd-87725edade2f service swift] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:26:20.374318 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f056f-f951-434f-89cd-87725edade2f service swift] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:26:20.379610 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323dac67dfab4c95b3c1d6ccc9b0a701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:26:20.380256 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] REQUEST_METHOD: `GET` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:26:20.380543 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:26:20.381077 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:26:20.389586 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:26:20.391068 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:26:20.399187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1471/2926] 10.222.0.78 () {60 vars in 1384 bytes} [Mon Jul 4 10:26:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 10:26:22.321244 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8de8-97ea-4848-a343-d1bbf377e87c None None] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:26:22.333640 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8de8-97ea-4848-a343-d1bbf377e87c None None] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:26:22.338389 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:26:22.339275 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:26:22.339730 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:26:22.340037 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] PATH_INFO: `/v3/users/90dd97df1c604430bf02cde0b2bdd414` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:26:22.341227 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90dd97df1c604430bf02cde0b2bdd414)` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:26:22.343174 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:26:22.391464 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90dd97df1c604430bf02cde0b2bdd414'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.392149 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90dd97df1c604430bf02cde0b2bdd414'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.399714 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90dd97df1c604430bf02cde0b2bdd414'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.406864 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90dd97df1c604430bf02cde0b2bdd414'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.407480 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.notifications [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90dd97df1c604430bf02cde0b2bdd414'} {{(pid=80353) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.426254 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1456/2927] 10.222.0.78 () {58 vars in 1223 bytes} [Mon Jul 4 10:26:22 2022] DELETE /identity/v3/users/90dd97df1c604430bf02cde0b2bdd414 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:26:22.605223 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] Authenticating user token {{(pid=80354) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:26:22.616884 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405f6c7-92d6-454c-a244-80ae6959bbac service swift] Validating token access rules against request {{(pid=80354) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:26:22.673833 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '657ce8ca189845ff90a9f70d2e00122f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b97d6692af504c1fa68b44270187348b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80354) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:26:22.675297 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:26:22.675612 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:26:22.675990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] PATH_INFO: `/v3/projects/2a0a67bf91ec461e860413539f25b6dc` {{(pid=80354) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:26:22.677187 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0a67bf91ec461e860413539f25b6dc)` {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:26:22.679099 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] RBAC: Authorization granted {{(pid=80354) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:26:22.724400 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0a67bf91ec461e860413539f25b6dc', 'request_id': 'req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.730600 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0a67bf91ec461e860413539f25b6dc', 'request_id': 'req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.736292 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0a67bf91ec461e860413539f25b6dc', 'request_id': 'req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d'} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.748990 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] The token cache is being invalidate because project 2a0a67bf91ec461e860413539f25b6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80354) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 10:26:22.749282 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.749906 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG keystone.notifications [None req-6b91ff76-9e1c-4cac-89e8-04b8a4c5476d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80354) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 10:26:22.751446 dv-cinder-848418-1-smb devstack@keystone.service[80354]: [pid: 80354|app: 0|req: 1472/2928] 10.222.0.78 () {58 vars in 1232 bytes} [Mon Jul 4 10:26:22 2022] DELETE /identity/v3/projects/2a0a67bf91ec461e860413539f25b6dc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 10:26:32.421909 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:26:32.745985 dv-cinder-848418-1-smb devstack@keystone.service[80354]: DEBUG dbcounter [-] [80354] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 10:28:40.472189 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Authenticating user token {{(pid=80353) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 10:28:40.474097 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:28:40.543293 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ba3f9-a75b-40d3-aa31-fce1b5fd2c4b admin admin] Validating token access rules against request {{(pid=80353) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 10:28:40.602674 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b179e9-98d9-455c-bbb4-20610aadc349 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe12b3ec01547eba1493e7a179c8af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd1740dc99442498a29fabcc4aa8bb8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80353) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 10:28:40.603330 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b179e9-98d9-455c-bbb4-20610aadc349 service placement] REQUEST_METHOD: `GET` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 10:28:40.603649 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b179e9-98d9-455c-bbb4-20610aadc349 service placement] SCRIPT_NAME: `/identity` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 10:28:40.603927 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b179e9-98d9-455c-bbb4-20610aadc349 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80353) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 10:28:40.605715 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.fernet_utils [None req-c0b179e9-98d9-455c-bbb4-20610aadc349 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80353) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 10:28:40.617155 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b179e9-98d9-455c-bbb4-20610aadc349 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 10:28:40.618719 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b179e9-98d9-455c-bbb4-20610aadc349 service placement] RBAC: Authorization granted {{(pid=80353) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 10:28:40.628919 dv-cinder-848418-1-smb devstack@keystone.service[80353]: [pid: 80353|app: 0|req: 1457/2929] 10.222.0.78 () {60 vars in 1365 bytes} [Mon Jul 4 10:28:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 10:28:50.624415 dv-cinder-848418-1-smb devstack@keystone.service[80353]: DEBUG dbcounter [-] [80353] Writing DB stats keystone:SELECT=58 {{(pid=80353) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}